-- Logs begin at Tue 2022-07-12 13:48:43 UTC, end at Tue 2022-07-12 14:53:04 UTC. -- Jul 12 14:23:42.334579 dv-cinder-836996-39-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 14:23:42.343956 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:23:42 2022] *** Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: nodename: dv-cinder-836996-39-iscsi Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: machine: x86_64 Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: clock source: unix Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: pcre jit disabled Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: detected number of CPU cores: 4 Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: current working directory: / Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:23:42.345954 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: your processes number limit is 47680 Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: your memory page size is 4096 bytes Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: detected max file descriptor number: 2048 Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: lock engine: pthread robust mutexes Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: thunder lock: enabled Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 14:23:42.346753 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:23:42.389355 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: Python main interpreter initialized at 0x56484beea9c0 Jul 12 14:23:42.389355 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: python threads support enabled Jul 12 14:23:42.389355 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: your server socket listen backlog is limited to 100 connections Jul 12 14:23:42.389355 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:23:42.389711 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:23:42.389785 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: *** Operational MODE: preforking *** Jul 12 14:23:42.390029 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:23:42.390029 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: spawned uWSGI master process (pid: 103404) Jul 12 14:23:42.390235 dv-cinder-836996-39-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 14:23:42.390800 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: spawned uWSGI worker 1 (pid: 103405, cores: 1) Jul 12 14:23:42.392383 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: spawned uWSGI worker 2 (pid: 103406, cores: 1) Jul 12 14:23:42.395474 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:23:43.078961 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:23:43.083822 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:23:44.212812 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:23:44.212812 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: from cryptography.utils import int_from_bytes Jul 12 14:23:44.213557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:23:44.213557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: from cryptography.utils import int_from_bytes Jul 12 14:23:44.220203 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:23:44.220203 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes Jul 12 14:23:44.220645 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:23:44.220645 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: from cryptography.utils import int_from_bytes Jul 12 14:23:46.780090 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:23:46.780719 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:23:46.780857 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:23:46.781145 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:23:46.781440 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:23:46.781829 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.782160 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.782486 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.782813 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.783663 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.783981 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.784305 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.784626 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.784955 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.785221 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.785404 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:23:46.785836 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.785999 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:23:46.786153 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-39-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.786319 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.786414 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:23:46.786581 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.786670 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:23:46.786778 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.786877 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:23:46.787106 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.787214 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.787406 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.787494 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.787730 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.787818 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788037 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788134 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788434 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788535 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788751 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.788965 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789062 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789272 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789427 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789609 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789722 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.789950 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790088 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790266 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790399 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790575 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790711 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-39-iscsi {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.790897 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791035 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791207 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791342 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791520 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791653 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791828 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.791953 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792141 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792279 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-39-iscsi {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792469 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792597 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792780 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.792934 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.793136 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.793287 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.793575 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.793704 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.793895 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794025 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794208 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794345 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794553 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794678 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.794872 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795059 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795196 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795504 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795630 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795820 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.795960 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.796152 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.796285 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.796466 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.796692 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.796859 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-39-iscsi {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797172 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797272 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797517 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797607 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797836 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.797945 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.798256 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.798353 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.798572 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.799370 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.799477 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.799779 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.799871 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800090 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800175 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800405 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800508 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800727 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.800821 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801044 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801203 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801405 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801491 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801704 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801813 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.801963 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802050 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802210 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802296 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802506 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802646 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.802877 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.803643 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.803770 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.803854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.803931 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804014 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804100 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804338 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804426 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804589 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804722 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804833 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.804915 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805469 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805623 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805711 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805791 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805867 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.805867 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806039 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806118 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806221 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806355 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806658 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806768 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.806973 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.807283 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.807368 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.807592 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.807883 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.807969 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.808198 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.808508 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.808626 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.808818 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.809080 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.809165 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.809469 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.809661 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.809793 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.810106 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.810306 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.810428 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.810826 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.810922 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.811083 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.811393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.811493 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.811736 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.811971 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812056 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812356 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812448 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812676 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812769 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.812999 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813086 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813308 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813475 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813642 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813734 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.813952 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814038 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814315 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814413 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814625 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814716 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.814939 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815033 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815192 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815285 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815501 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815598 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815809 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.815894 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816132 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816225 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816442 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816527 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816752 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.816847 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817061 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817147 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817381 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817469 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817693 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.817793 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818002 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818110 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818310 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818405 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818616 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818698 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.818922 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819014 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819227 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819311 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819532 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819615 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819840 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.819926 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820149 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820234 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820454 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820544 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820761 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.820853 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821069 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821163 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821394 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821480 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821704 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.821791 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822011 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822316 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822477 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822647 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822778 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.822966 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823115 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823248 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823416 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823608 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823730 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823892 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.823980 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824166 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824260 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824495 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824594 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824778 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.824865 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825127 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825252 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825411 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825499 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825722 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.825876 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826034 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826207 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826356 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826452 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826638 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826725 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.826940 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827162 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827285 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827440 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827525 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827658 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827827 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.827923 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828125 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828221 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828428 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828512 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.828822 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829045 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829137 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829380 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829469 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829750 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.829853 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.830010 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.830094 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.830318 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.830403 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.830637 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:23:46.830724 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.830978 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831062 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831296 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831380 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831633 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831720 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.831955 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832038 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832273 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832365 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832588 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832674 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832903 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.832988 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833224 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833426 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833560 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833645 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833881 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.833975 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834195 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834288 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834511 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834596 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834828 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.834914 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835151 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835260 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835468 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835554 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835787 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.835874 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836108 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836202 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836432 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836518 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836757 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.836851 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.837074 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.837168 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.837421 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.837759 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.837858 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.838085 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.838180 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.838400 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.838680 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.838766 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839065 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839151 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839389 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839502 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839718 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.839979 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840074 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840317 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840422 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840653 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840745 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.840970 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.841114 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.841294 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.841604 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.841690 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.841937 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842034 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842272 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842470 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842590 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842908 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.842994 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843226 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843321 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843542 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843635 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843858 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.843945 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844170 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844255 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844487 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844572 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844801 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.844890 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.845120 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.845225 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.845998 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846095 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846309 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846407 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846626 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846719 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.846943 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847027 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847256 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847349 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847567 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847662 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847878 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.847964 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848185 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848281 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848492 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848586 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848795 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.848879 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849109 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849206 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849442 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849553 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849764 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.849851 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850080 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850165 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850392 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850479 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850706 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.850791 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851021 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851105 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851330 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851416 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851650 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851778 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.851958 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852051 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852262 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852415 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852577 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852667 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852891 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.852978 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853205 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853291 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853531 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853627 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853843 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.853945 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854169 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854290 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854468 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854554 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854826 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.854927 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855063 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855179 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855384 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855540 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855699 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.855795 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856011 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856097 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856325 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856409 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856625 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856782 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.856950 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857047 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857264 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857516 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857740 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857825 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.857929 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858015 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858259 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858345 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858567 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858665 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858876 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.858962 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859193 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859290 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859505 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859591 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859807 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.859891 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860114 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860207 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860419 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860504 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860725 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.860822 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.861030 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.861129 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.861936 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862048 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862239 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862324 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862546 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862644 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862853 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.862948 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863160 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863247 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863466 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863560 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863772 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.863856 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864081 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864173 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864386 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864479 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864691 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864777 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.864995 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.865083 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.865355 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.865444 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.865665 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.865762 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866009 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866103 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866336 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866422 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866652 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866736 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.866967 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867050 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867279 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867366 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867591 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867683 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867901 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.867994 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868214 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868307 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868527 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868622 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868837 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.868930 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869152 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869244 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869490 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869579 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869807 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.869909 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870116 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870201 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870425 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870510 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.870835 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871057 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871151 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871364 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871450 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871678 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.871772 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872016 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872102 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872329 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872415 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872666 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872837 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.872968 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873062 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873274 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873408 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873619 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873707 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.873949 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874088 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874268 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874356 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874550 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874642 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874861 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.874943 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875179 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875341 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875496 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875585 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875805 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.875891 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.876114 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.876287 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.876438 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.876522 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.876744 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.877323 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.877579 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.877751 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.877897 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878025 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878196 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878284 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878517 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878614 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878844 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.878929 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879152 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879245 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879463 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879556 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879780 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.879865 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880086 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880182 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880394 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880487 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880708 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.880830 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881001 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881094 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881300 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881419 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881636 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881722 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.881946 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882033 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882254 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882340 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882566 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882652 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882871 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.882955 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883177 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883269 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883485 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883569 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883797 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.883882 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884112 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884199 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884438 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884524 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884765 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.884851 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885076 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885310 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885425 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885660 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885746 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.885986 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886081 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886295 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886382 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886602 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886688 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.886923 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887008 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887233 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887317 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887542 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887634 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887850 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.887937 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888158 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888251 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888488 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888573 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888804 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.888890 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889109 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889201 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889450 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889766 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.889852 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890076 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890161 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890393 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890495 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890705 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.890790 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891015 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891099 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891329 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891421 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891642 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.891726 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892000 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892092 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892285 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892478 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892653 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.892811 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893008 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893246 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893436 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893610 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893747 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.893927 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.894015 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.894253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.894417 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.894773 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.894869 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.895182 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.895273 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.895475 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896075 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896298 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896403 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896622 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896861 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.896949 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.897271 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.897487 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.897662 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.897838 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.897958 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.898133 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.898280 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.898507 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.898607 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.898886 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899056 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899199 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899354 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899518 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899688 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.899831 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900020 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900143 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900364 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900460 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900675 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900768 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.900988 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.901074 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.901297 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.901415 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.901700 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.901798 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902017 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902103 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902329 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902422 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902640 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902725 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.902948 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903034 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903259 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903351 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903568 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903652 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903876 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.903962 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904183 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904277 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904490 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904575 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904801 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.904899 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905108 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905201 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905448 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905538 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905762 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.905855 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906088 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906176 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906400 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906486 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906710 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.906795 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907016 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907102 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907322 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907407 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907666 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907759 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.907986 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.908576 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.908805 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.908889 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909120 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909214 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909459 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909558 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909773 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.909858 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910089 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910183 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910404 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910489 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910710 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.910801 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911016 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911110 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911320 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911405 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911629 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911713 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.911937 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912043 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912236 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912321 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912548 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912634 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.912940 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913162 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913247 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913500 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913589 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913813 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.913900 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914119 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914204 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914423 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914517 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.914814 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915039 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915124 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915344 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915438 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915649 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915734 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.915956 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916041 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916264 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916356 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916570 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916656 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916874 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.916958 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917175 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917268 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917516 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917615 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917823 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.917916 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.918129 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.918222 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.918430 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.918685 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.918779 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919003 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919329 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919415 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919649 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919873 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.919962 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.920253 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.920448 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.920559 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.920871 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.921023 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.921178 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.921506 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.921621 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.921819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.922144 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.922229 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.922463 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.922771 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.922859 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.923080 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.923365 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.923451 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.923733 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924004 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924090 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924336 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924604 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924690 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.924934 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.925198 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.925291 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.925555 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.925818 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.925911 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.926170 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.926401 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.926487 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.926771 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.926993 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.927079 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.927366 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.927585 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.927709 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928015 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928204 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928372 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928678 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928805 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.928995 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.929318 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.929480 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.929664 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.929966 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.930335 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.930534 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.930829 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.930915 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.931143 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.931454 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.931539 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.931768 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932053 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932140 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932365 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932687 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932771 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.932998 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.933301 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.933426 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.933655 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.933933 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.934019 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.934290 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.934557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.934687 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.934896 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.935164 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.935250 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.935505 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.935762 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.935856 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.936114 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.936381 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.936466 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.936723 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.936968 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.937062 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.937355 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.937597 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.937786 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.937972 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938100 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938271 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938499 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938569 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938842 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.938970 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.939186 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.939897 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940068 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940221 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940388 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940484 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940730 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.940896 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941077 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941251 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941443 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941631 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941781 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.941919 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942087 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942312 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942399 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942627 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942799 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.942962 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943052 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943239 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943326 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943552 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943640 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943865 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.943952 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944167 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944330 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944479 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944575 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944785 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.944871 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945179 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945272 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945526 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945613 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945838 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.945924 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946150 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946236 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946461 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946548 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946794 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.946880 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.947113 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.947325 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.947412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.947693 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.947779 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948030 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948116 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948349 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948606 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948697 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.948969 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.949081 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.949352 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.949455 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.949732 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.949818 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.950045 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.950236 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.950362 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.950679 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.950777 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.951001 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.951095 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.951323 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.951581 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.951668 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952002 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952097 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952319 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952414 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952634 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952721 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.952955 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953040 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953268 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953399 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953607 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953694 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.953916 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954001 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954234 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954320 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954542 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954635 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.954887 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.955493 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.955739 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.955835 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956054 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956147 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956371 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956457 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956680 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.956774 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957004 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957131 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957344 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957477 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957666 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957793 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.957991 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.958213 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.958402 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.958528 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.958734 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.958866 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959045 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959161 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959370 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959489 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959698 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.959819 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960006 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960225 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960329 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960436 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960612 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960751 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.960920 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961083 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961228 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961439 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961575 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961758 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.961882 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962119 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962201 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962378 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962494 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962706 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.962807 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963035 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963122 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963356 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963450 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963685 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963780 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.963999 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964084 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964323 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964417 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964639 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964726 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.964962 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965048 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965284 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965386 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965616 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965703 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.965940 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966029 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966250 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966337 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966559 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966646 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966865 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.966960 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967171 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967258 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967501 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967595 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967812 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.967898 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968127 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968221 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968442 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968536 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968754 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.968882 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969067 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969163 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969422 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969513 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969737 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.969823 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970056 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970159 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970375 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970464 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970722 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.970808 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971029 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971129 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971335 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971425 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971647 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971733 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.971953 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972041 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972260 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972346 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972566 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972651 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972873 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.972960 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973177 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973263 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973510 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973609 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973820 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.973916 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974142 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974228 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974449 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974535 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974773 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.974860 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975082 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975228 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975388 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975489 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975692 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975785 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.975995 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976082 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976335 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976432 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976642 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.976976 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977063 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977292 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977437 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977629 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977717 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.977940 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978035 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978250 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978344 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978565 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978659 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978874 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.978968 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979183 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979277 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979493 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979587 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979806 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.979891 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980113 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980199 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980426 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980511 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980739 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.980864 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981049 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981177 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981372 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981472 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981685 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.981772 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982006 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982105 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982326 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982550 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982665 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982877 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.982987 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.983193 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.983315 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.983510 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.983648 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.983825 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984004 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984151 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984298 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984443 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984618 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984747 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.984928 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985021 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985271 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985389 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985648 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985754 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.985932 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.986020 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.986768 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.986976 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987109 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987193 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987445 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987561 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987712 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.987800 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988037 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988233 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988361 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988447 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988668 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.988894 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.989059 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.989231 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.989411 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.989579 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.989883 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990090 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990207 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990327 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990527 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990725 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.990847 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991168 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991258 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991487 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991625 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991803 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.991991 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.992120 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.992390 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.992478 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.992768 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.992854 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.993100 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.993286 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.993480 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.993653 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.993806 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994060 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994156 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994436 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994543 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994759 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.994875 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995119 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995216 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995447 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995533 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995760 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.995846 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996081 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996168 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996402 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996488 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996722 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.996945 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997040 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997266 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997374 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997632 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.997964 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998051 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998277 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998364 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998591 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998677 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.998907 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999039 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999225 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999318 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999535 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999628 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:46.999844 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000031 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000159 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000246 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000473 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000605 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000782 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.000869 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.001103 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.001188 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.001438 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.001658 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.001766 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.002539 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.002642 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.002882 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.002972 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.003213 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.003428 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.003543 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.003780 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.003867 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004105 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004200 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004436 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004523 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004763 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.004850 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005084 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005171 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005420 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005509 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005737 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.005843 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006042 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006136 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006351 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006437 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006668 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006762 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.006977 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007064 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007282 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007375 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007588 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007676 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.007902 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008128 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008215 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008491 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008577 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008803 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.008890 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009110 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009196 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009466 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009776 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.009864 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010083 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010170 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010389 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010475 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010828 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.010934 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011013 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011090 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011291 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011379 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011599 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011692 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011905 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.011991 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012216 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012310 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012518 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012604 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012829 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.012916 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013138 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013233 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013482 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013573 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013789 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.013887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014106 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014203 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014415 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014502 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014728 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.014815 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015038 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015133 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015357 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015449 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015667 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015752 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.015976 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016069 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016286 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016373 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016597 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016690 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016907 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.016993 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.017214 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.017307 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.017592 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.017680 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.017907 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018136 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018307 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018472 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018594 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018794 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.018965 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019129 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019265 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019463 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019625 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019807 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.019898 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020081 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020304 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020391 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020469 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020701 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.020902 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021075 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021173 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021488 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021573 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021667 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021747 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.021968 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022114 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022284 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022371 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022598 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022835 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.022923 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023173 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023262 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023500 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023588 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023810 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.023897 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024129 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024217 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024458 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024546 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024772 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.024859 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.025085 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.025283 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.025430 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.025711 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.025800 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026056 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026143 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026373 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026623 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026718 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.026995 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027082 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027312 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027407 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027627 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027804 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.027942 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028205 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028293 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028556 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028650 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028873 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.028961 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.029187 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.029441 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.029534 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.029837 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.029924 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030231 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030324 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030493 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030580 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030818 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.030949 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031140 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031235 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031463 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031551 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031777 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.031865 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032091 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032189 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032406 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032500 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032720 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.032807 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033065 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033163 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033424 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033742 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.033827 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034051 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034150 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034407 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034496 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.034831 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035063 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035158 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035374 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035461 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035682 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035768 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.035990 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036077 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036303 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036391 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036624 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036710 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.036938 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037035 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037242 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037366 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037578 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037744 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037892 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.037987 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038199 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038286 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038504 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038600 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038808 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.038902 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039113 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039199 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039424 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039519 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039729 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.039822 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040034 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040121 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040339 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040435 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040646 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040731 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.040949 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041034 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041253 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041368 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041585 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041683 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041892 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.041986 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042197 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042284 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042498 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042585 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042803 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.042896 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043107 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043194 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043417 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043504 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043725 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.043811 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044033 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044127 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044340 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044435 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044647 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044746 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.044959 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045046 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045267 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045397 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045605 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045705 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.045915 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046001 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046224 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046311 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046530 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046625 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046862 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.046949 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047177 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047263 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047491 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047585 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047805 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.047891 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.048117 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.048202 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.048430 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.048522 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.049255 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.049383 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.049612 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.049710 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.049940 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050027 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050247 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050332 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050566 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050655 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050884 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.050973 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051205 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051298 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051522 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051607 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051836 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.051923 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052152 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052246 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052465 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052685 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052859 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.052943 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053078 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053196 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053417 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053567 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053700 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.053790 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054024 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054116 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054360 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054490 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054671 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.054759 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055237 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055328 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055558 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055644 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055884 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.055984 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056189 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056276 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056506 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056842 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.056992 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057197 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057287 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057506 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057602 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057822 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.057922 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.058136 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.058236 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.058443 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.058530 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.058687 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:23:47.058774 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.059084 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.059416 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.059750 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.060102 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.060422 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.060767 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.061099 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.061445 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.061768 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.062078 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:23:47.062328 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:23:47.121024 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Registered counter for database nova_api Jul 12 14:23:47.123426 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO dbcounter [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Registered counter for database nova_api Jul 12 14:23:47.236571 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_db.sqlalchemy.engines [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.238826 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.243207 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writer thread running {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.245858 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.299101 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.context [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8(cell1) {{(pid=103405) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:23:47.303031 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_concurrency.lockutils [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:23:47.303225 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.context [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8(cell1) {{(pid=103406) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:23:47.304604 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_concurrency.lockutils [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:23:47.305704 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_concurrency.lockutils [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:23:47.307403 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:23:47.307776 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_concurrency.lockutils [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:23:47.308989 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:23:47.309761 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO dbcounter [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Registered counter for database nova_cell0 Jul 12 14:23:47.309877 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:23:47.312456 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:23:47.313674 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO dbcounter [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Registered counter for database nova_cell1 Jul 12 14:23:47.315012 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Registered counter for database nova_cell0 Jul 12 14:23:47.319899 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Registered counter for database nova_cell1 Jul 12 14:23:47.321560 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_db.sqlalchemy.engines [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.323958 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_db.sqlalchemy.engines [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.327317 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.328593 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writer thread running {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.330531 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.334419 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.334721 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writer thread running {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.471742 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.476927 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO dbcounter [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Registered counter for database nova_cell0 Jul 12 14:23:47.482253 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO dbcounter [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Registered counter for database nova_cell0 Jul 12 14:23:47.486757 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG oslo_db.sqlalchemy.engines [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.490870 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:23:47.491189 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writer thread running {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.495526 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writer thread running {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:23:47.827611 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:23:47.835533 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:23:47.837915 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: WARNING keystonemiddleware.auth_token [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:23:47.845069 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: WARNING keystonemiddleware.auth_token [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:23:48.176503 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:23:48.182843 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: WARNING keystonemiddleware.auth_token [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:23:48.187923 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56484beea9c0 pid: 103406 (default app) Jul 12 14:23:48.190569 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:23:48.191751 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002295 Jul 12 14:23:48.192155 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Jul 12 14:23:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:23:48.198732 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: WARNING keystonemiddleware.auth_token [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:23:48.206357 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: WARNING keystonemiddleware.auth_token [None req-07e046e7-a177-456d-90e0-b6770227c6a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:23:48.211582 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56484beea9c0 pid: 103405 (default app) Jul 12 14:25:04.100204 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:04.101210 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 12 14:25:04.101853 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:25:04.113963 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_api:SELECT=3 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:04.115094 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_cell1:SELECT=3 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:04.115800 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_cell0:SELECT=3 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:04.116515 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:04.983249 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-9887464e-030b-4d20-92dd-3b315f376d38 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:05.015123 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-9887464e-030b-4d20-92dd-3b315f376d38 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906719 Jul 12 14:25:05.015856 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 14:25:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:07.231563 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:07.232938 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2a8567b0-4160-416a-b738-1bd004100a62 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 12 14:25:07.233648 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:07.683459 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-aff60537-7d28-45a2-8535-5bbe1a2a8635 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "id": "c1", "name": "cirros256"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:07.701724 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:25:07.701724 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: warnings.warn(msg) Jul 12 14:25:07.730472 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-aff60537-7d28-45a2-8535-5bbe1a2a8635 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490488 Jul 12 14:25:07.731042 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:07.745291 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.746123 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.747259 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=3 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.747985 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.951099 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a5955555-6e42-4cf1-8852-6f5de9efad46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:07.954130 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:25:07.954130 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:25:08.017456 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a5955555-6e42-4cf1-8852-6f5de9efad46 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277650 Jul 12 14:25:08.018229 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 14:25:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:10.286605 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-aff60537-7d28-45a2-8535-5bbe1a2a8635 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:10.287624 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-aff60537-7d28-45a2-8535-5bbe1a2a8635 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 12 14:25:10.288240 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:10.947218 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5231d36d-ea29-4c04-9c39-b6b3b0fa25be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "name": "ds512M"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:10.965312 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:25:10.965312 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:25:10.986936 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5231d36d-ea29-4c04-9c39-b6b3b0fa25be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.692728 Jul 12 14:25:10.987801 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:11.000017 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-0064997c-ba9c-46dc-97db-8009ecc7ca40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:11.001532 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:25:11.001532 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: warnings.warn(msg) Jul 12 14:25:11.033813 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-0064997c-ba9c-46dc-97db-8009ecc7ca40 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038037 Jul 12 14:25:11.034590 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 14:25:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:13.257706 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5231d36d-ea29-4c04-9c39-b6b3b0fa25be admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:13.259049 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5231d36d-ea29-4c04-9c39-b6b3b0fa25be admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 12 14:25:13.263809 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:13.702834 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-b8695be7-d504-4faf-8018-a7b8970acfab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:13.721960 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-b8695be7-d504-4faf-8018-a7b8970acfab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457163 Jul 12 14:25:13.722551 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:25:13.735904 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-618c9624-df63-437a-82f1-2b3161c06db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:13.758628 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-618c9624-df63-437a-82f1-2b3161c06db5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027084 Jul 12 14:25:13.759193 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 14:25:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:15.986537 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-b8695be7-d504-4faf-8018-a7b8970acfab admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:15.987557 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-b8695be7-d504-4faf-8018-a7b8970acfab admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 12 14:25:15.988209 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:16.393067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5ec633b3-2fcd-4564-9847-8458cf88ef88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:16.428108 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5ec633b3-2fcd-4564-9847-8458cf88ef88 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434330 Jul 12 14:25:16.428658 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:16.441536 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-1561bd49-8ab2-4997-b099-f852379cfe18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:16.464946 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-1561bd49-8ab2-4997-b099-f852379cfe18 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027492 Jul 12 14:25:16.465443 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 14:25:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:25:18.739019 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5ec633b3-2fcd-4564-9847-8458cf88ef88 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:18.740030 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5ec633b3-2fcd-4564-9847-8458cf88ef88 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 12 14:25:18.740438 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:19.176245 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:19.195212 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448893 Jul 12 14:25:19.196439 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:19.208298 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5147052a-145f-4e2a-81ca-e3415a5b1543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:19.231976 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5147052a-145f-4e2a-81ca-e3415a5b1543 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027335 Jul 12 14:25:19.232562 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Tue Jul 12 14:25:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:21.635496 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:21.636412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 12 14:25:21.636845 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:22.074318 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-445ee851-0ab9-4bf9-b6be-4e427e2dde02 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:22.097878 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-445ee851-0ab9-4bf9-b6be-4e427e2dde02 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454615 Jul 12 14:25:22.098420 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 14:25:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:25:24.330396 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:24.331427 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-22164c86-4d99-4376-b18a-c2ca99ca340d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 12 14:25:24.332098 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:24.772149 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-856cdb6f-4d84-416d-b66e-5a79aa930ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "swap": 0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:24.792245 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-856cdb6f-4d84-416d-b66e-5a79aa930ed3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454174 Jul 12 14:25:24.792944 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:24.805387 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-3dc40456-4f83-43ed-abe0-66642b488e3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:24.829729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-3dc40456-4f83-43ed-abe0-66642b488e3c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027931 Jul 12 14:25:24.830307 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 14:25:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:27.017462 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-856cdb6f-4d84-416d-b66e-5a79aa930ed3 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:27.018505 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-856cdb6f-4d84-416d-b66e-5a79aa930ed3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 12 14:25:27.018924 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:27.412548 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-a1a556ee-d01f-4b31-8c85-a5dc05f5029e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:27.430158 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-a1a556ee-d01f-4b31-8c85-a5dc05f5029e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.405289 Jul 12 14:25:27.430999 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:25:27.443200 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-9c641dce-cd2b-4b16-aa91-aadeab814214 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:27.465087 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-9c641dce-cd2b-4b16-aa91-aadeab814214 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025508 Jul 12 14:25:27.465826 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 14:25:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:25:29.671347 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-a1a556ee-d01f-4b31-8c85-a5dc05f5029e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:29.672360 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-a1a556ee-d01f-4b31-8c85-a5dc05f5029e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 14:25:29.672750 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:30.056272 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a1d86611-911f-4148-bca7-9941e73921b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "disk": 40}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:30.073727 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a1d86611-911f-4148-bca7-9941e73921b0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.394732 Jul 12 14:25:30.074281 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:25:30.087248 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-60ef84d6-8888-4bc5-863a-1b3fce9357e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:30.115057 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-60ef84d6-8888-4bc5-863a-1b3fce9357e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031826 Jul 12 14:25:30.115645 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 14:25:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:25:32.392633 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a1d86611-911f-4148-bca7-9941e73921b0 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:32.394314 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a1d86611-911f-4148-bca7-9941e73921b0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Jul 12 14:25:32.394711 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:32.839297 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-5e5c2552-335d-44b5-a7c3-9f279a26fd88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:32.860746 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-5e5c2552-335d-44b5-a7c3-9f279a26fd88 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460220 Jul 12 14:25:32.861603 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:32.874024 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-581fec9e-6316-4c44-abb2-0cb6242aa8ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:32.897013 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-581fec9e-6316-4c44-abb2-0cb6242aa8ca admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027245 Jul 12 14:25:32.909403 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 14:25:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:25:35.136201 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-5e5c2552-335d-44b5-a7c3-9f279a26fd88 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:35.137312 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-5e5c2552-335d-44b5-a7c3-9f279a26fd88 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 12 14:25:35.137969 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:35.616344 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:35.645315 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.500961 Jul 12 14:25:35.653710 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Tue Jul 12 14:25:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:35.658175 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-9ac570ea-41af-4cb7-ba22-2580bd1db70c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:25:35.662824 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:35.729140 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-9ac570ea-41af-4cb7-ba22-2580bd1db70c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074586 Jul 12 14:25:35.730426 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Tue Jul 12 14:25:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:25:55.329045 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:55.330161 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Jul 12 14:25:55.330552 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:25:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:55.340802 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:55.722441 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-49edc6ff-75de-4796-b4ba-c1f660ed4172 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:55.738956 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-49edc6ff-75de-4796-b4ba-c1f660ed4172 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402548 Jul 12 14:25:55.739477 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 14:25:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:25:56.807578 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:56.808576 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2d2b4dae-8221-459d-925a-8afa2580cdcd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 12 14:25:56.808968 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:57.320371 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-e2b614da-b756-4c1e-902d-962f9fee09e5 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:57.326489 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.wsgi [None req-e2b614da-b756-4c1e-902d-962f9fee09e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-e2b614da-b756-4c1e-902d-962f9fee09e5 admin admin] Request method failure captured: Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept: application/json Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept-Encoding: gzip, deflate Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Connection: keep-alive Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Content-Length: 0 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Host: 10.222.0.25 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-Api-Version: compute 2.90 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-System-Scope: None Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: User-Agent: python-novaclient Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Auth-Token: gAAAAABizYR0Syd07EFMi1HntMi3gWXlmBAq3kkJhRoiOYRmcEgcLsgYSAtvVk9diPU_wLYx_HHvs3jgB12UoMvyx7mdnxZwGJc6QGZxmF5v5lbq-v7CO7WwydVM-m9N_XISAGTaTU0WsPFf4Nm6b1YY4WAhOJyuj_OL2Xttj2AiPIK3y2_uYhE Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Id: None Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Name: None Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Identity-Status: Confirmed Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Is-Admin-Project: True Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Id: default Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Name: Default Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Name: admin Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Role: admin,reader,member Jul 12 14:25:57.329786 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Roles: admin,reader,member Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant: admin Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Name: admin Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User: admin Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Id: default Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Name: Default Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Name: admin Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: method: > Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: exception: Flavor 42 could not be found. Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: action_args: {'id': '42'} Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:25:57.331377 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:57.332253 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.334854 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-e2b614da-b756-4c1e-902d-962f9fee09e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:25:57.335930 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-e2b614da-b756-4c1e-902d-962f9fee09e5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.385565 Jul 12 14:25:57.335930 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 14:25:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:57.341277 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-8fb404b1-f5cb-4310-a7e9-1a7fff12de96 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:57.344252 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:57.363390 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-8fb404b1-f5cb-4310-a7e9-1a7fff12de96 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025674 Jul 12 14:25:57.363869 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:25:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:25:57.373873 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-4ef2f84c-5823-41b2-90f7-992999b54c8d admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:57.395159 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-4ef2f84c-5823-41b2-90f7-992999b54c8d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025262 Jul 12 14:25:57.395692 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:25:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:25:57.404724 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-99d97f44-63ad-43ab-a6ff-9357e5d7f633 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:57.410532 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-99d97f44-63ad-43ab-a6ff-9357e5d7f633 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-99d97f44-63ad-43ab-a6ff-9357e5d7f633 admin admin] Request method failure captured: Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept: application/json Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Connection: keep-alive Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Content-Length: 0 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Host: 10.222.0.25 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABizYR0Syd07EFMi1HntMi3gWXlmBAq3kkJhRoiOYRmcEgcLsgYSAtvVk9diPU_wLYx_HHvs3jgB12UoMvyx7mdnxZwGJc6QGZxmF5v5lbq-v7CO7WwydVM-m9N_XISAGTaTU0WsPFf4Nm6b1YY4WAhOJyuj_OL2Xttj2AiPIK3y2_uYhE Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Role: admin,reader,member Jul 12 14:25:57.414028 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Roles: admin,reader,member Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant: admin Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User: admin Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Name: admin Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: method: > Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: exception: Flavor 42 could not be found. Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: action_args: {'id': '42'} Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:25:57.415580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:57.416514 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:57.417819 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-99d97f44-63ad-43ab-a6ff-9357e5d7f633 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:25:57.419581 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-99d97f44-63ad-43ab-a6ff-9357e5d7f633 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014222 Jul 12 14:25:57.421689 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 14:25:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:58.366750 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-4ef2f84c-5823-41b2-90f7-992999b54c8d admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:58.367754 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-4ef2f84c-5823-41b2-90f7-992999b54c8d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 12 14:25:58.368144 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:25:58.883778 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e90fc8a-5475-4e79-a45f-3fa327384334 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:58.889050 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-0e90fc8a-5475-4e79-a45f-3fa327384334 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e90fc8a-5475-4e79-a45f-3fa327384334 admin admin] Request method failure captured: Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept: application/json Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Connection: keep-alive Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Content-Length: 0 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Host: 10.222.0.25 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABizYR2Bb3Vfvlp7QyWNlSyUpE_cfIQG7qNz4rAmCmhQqBRc74ZgtvdWqdNiBFJuSQGhvk8sPy_nUWyCmlp1I-SPaAiz1mmsrgv7fcnrwKf6Zx5KhzDj2NYcKK3HJo4TuZHC6ZBzopzPshbrNDemK680f9NxgB4zXPcHjMCk0SBHVe5ho0 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Role: admin,reader,member Jul 12 14:25:58.890601 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Roles: admin,reader,member Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant: admin Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User: admin Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Name: admin Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: method: > Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: exception: Flavor 84 could not be found. Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: action_args: {'id': '84'} Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:25:58.892097 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:58.893067 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.894343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-0e90fc8a-5475-4e79-a45f-3fa327384334 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:25:58.895570 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-0e90fc8a-5475-4e79-a45f-3fa327384334 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388988 Jul 12 14:25:58.895570 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 14:25:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:25:58.901703 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-bcd0704b-d584-4d08-9549-7641f99573c5 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:58.915722 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-bcd0704b-d584-4d08-9549-7641f99573c5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017720 Jul 12 14:25:58.916276 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:25:58.925634 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-34d85d0d-ce12-425f-82a7-81eecde8442c admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:58.939699 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-34d85d0d-ce12-425f-82a7-81eecde8442c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017574 Jul 12 14:25:58.940200 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:25:58.949144 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-f9dc88ce-533d-448a-a127-084cee3ffe45 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:58.954906 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.wsgi [None req-f9dc88ce-533d-448a-a127-084cee3ffe45 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-f9dc88ce-533d-448a-a127-084cee3ffe45 admin admin] Request method failure captured: Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept: application/json Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept-Encoding: gzip, deflate Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Connection: keep-alive Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Content-Length: 0 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Host: 10.222.0.25 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-Api-Version: compute 2.90 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-System-Scope: None Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: User-Agent: python-novaclient Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Auth-Token: gAAAAABizYR2Bb3Vfvlp7QyWNlSyUpE_cfIQG7qNz4rAmCmhQqBRc74ZgtvdWqdNiBFJuSQGhvk8sPy_nUWyCmlp1I-SPaAiz1mmsrgv7fcnrwKf6Zx5KhzDj2NYcKK3HJo4TuZHC6ZBzopzPshbrNDemK680f9NxgB4zXPcHjMCk0SBHVe5ho0 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Id: None Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Name: None Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Identity-Status: Confirmed Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Is-Admin-Project: True Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Id: default Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Name: Default Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Name: admin Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Role: admin,reader,member Jul 12 14:25:58.956412 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Roles: admin,reader,member Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant: admin Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Name: admin Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User: admin Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Id: default Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Name: Default Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Name: admin Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: method: > Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: exception: Flavor 84 could not be found. Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: action_args: {'id': '84'} Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:25:58.957888 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:58.958817 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:25:58.960019 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-f9dc88ce-533d-448a-a127-084cee3ffe45 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:25:58.961181 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-f9dc88ce-533d-448a-a127-084cee3ffe45 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012094 Jul 12 14:25:58.961181 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Jul 12 14:25:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 14:25:59.914348 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-34d85d0d-ce12-425f-82a7-81eecde8442c admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:25:59.915386 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-34d85d0d-ce12-425f-82a7-81eecde8442c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 12 14:25:59.915784 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:00.437995 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-358b3630-0f3c-4102-a0ad-3edabab931a9 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:00.443871 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.wsgi [None req-358b3630-0f3c-4102-a0ad-3edabab931a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-358b3630-0f3c-4102-a0ad-3edabab931a9 admin admin] Request method failure captured: Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept: application/json Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Accept-Encoding: gzip, deflate Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Connection: keep-alive Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Content-Length: 0 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Host: 10.222.0.25 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-Api-Version: compute 2.90 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Openstack-System-Scope: None Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: User-Agent: python-novaclient Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Auth-Token: gAAAAABizYR37KorHDdRWY5CG_loEclNsCYnHgNflh_GaQPV9Ed_oxgoCWgdQGcKhCRicOTlgQRsSmFotcLMBu34OcYkcz7Szve5FBW3zEf7brRxiis9vlrfbRwCxHtD4VzmOwcESgRn3D3YYKC55WJBZlPFRsIuplAJ2FdD2kp5stauSz9xxjc Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Id: None Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Domain-Name: None Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Identity-Status: Confirmed Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Is-Admin-Project: True Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Id: default Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Domain-Name: Default Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Project-Name: admin Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Role: admin,reader,member Jul 12 14:26:00.445393 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Roles: admin,reader,member Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant: admin Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-Tenant-Name: admin Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User: admin Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Id: default Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Domain-Name: Default Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: X-User-Name: admin Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: method: > Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: exception: Flavor 451 could not be found. Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: action_args: {'id': '451'} Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:26:00.446941 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:26:00.447887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.449167 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-358b3630-0f3c-4102-a0ad-3edabab931a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:26:00.451127 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-358b3630-0f3c-4102-a0ad-3edabab931a9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395107 Jul 12 14:26:00.451127 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:26:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:00.456850 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-922264d2-e6ed-41a2-8b2f-d15b7570c244 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:00.470826 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-922264d2-e6ed-41a2-8b2f-d15b7570c244 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017510 Jul 12 14:26:00.471358 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:26:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:26:00.480649 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:00.496026 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018835 Jul 12 14:26:00.496546 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Jul 12 14:26:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:26:00.505745 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a5d03714-d03e-44bc-b223-91fe422eb08a admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:00.511051 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.wsgi [None req-a5d03714-d03e-44bc-b223-91fe422eb08a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a5d03714-d03e-44bc-b223-91fe422eb08a admin admin] Request method failure captured: Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept: application/json Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Accept-Encoding: gzip, deflate Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Connection: keep-alive Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Content-Length: 0 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Host: 10.222.0.25 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-Api-Version: compute 2.90 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Openstack-System-Scope: None Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: User-Agent: python-novaclient Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Auth-Token: gAAAAABizYR37KorHDdRWY5CG_loEclNsCYnHgNflh_GaQPV9Ed_oxgoCWgdQGcKhCRicOTlgQRsSmFotcLMBu34OcYkcz7Szve5FBW3zEf7brRxiis9vlrfbRwCxHtD4VzmOwcESgRn3D3YYKC55WJBZlPFRsIuplAJ2FdD2kp5stauSz9xxjc Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Id: None Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Domain-Name: None Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Identity-Status: Confirmed Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Is-Admin-Project: True Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Id: default Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Domain-Name: Default Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Project-Name: admin Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Role: admin,reader,member Jul 12 14:26:00.512529 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Roles: admin,reader,member Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63dcdffb6815414f8835106f58a82105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63dcdffb6815414f8835106f58a82105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63dcdffb6815414f8835106f58a82105", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant: admin Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Id: 63dcdffb6815414f8835106f58a82105 Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-Tenant-Name: admin Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User: admin Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Id: default Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Domain-Name: Default Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Id: a1d6aa7bda7d44f4ab9f044e2d9e08a7 Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: X-User-Name: admin Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: method: > Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: exception: Flavor 451 could not be found. Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: action_args: {'id': '451'} Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:26:00.514737 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:26:00.515716 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: ERROR nova.api.openstack.wsgi Jul 12 14:26:00.517091 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-a5d03714-d03e-44bc-b223-91fe422eb08a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:26:00.518343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-a5d03714-d03e-44bc-b223-91fe422eb08a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012263 Jul 12 14:26:00.518343 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:26:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 14:26:01.482488 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:01.483493 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Jul 12 14:26:01.483878 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:02.002408 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-8fc741b3-5a58-417d-a6e5-124dd459e775 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:26:02.020005 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-8fc741b3-5a58-417d-a6e5-124dd459e775 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399285 Jul 12 14:26:02.020526 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 14:26:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:26:02.983490 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:02.984492 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 12 14:26:02.984884 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:03.508539 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-65270d3f-6c38-4c9b-9a5f-79a767f0512a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:26:03.525373 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-65270d3f-6c38-4c9b-9a5f-79a767f0512a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402514 Jul 12 14:26:03.525903 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 14:26:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:26:04.485120 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:04.486195 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 12 14:26:04.486588 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:05.121477 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-44c14f70-ed60-46b3-b0ac-f815d9513001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:26:05.139209 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-44c14f70-ed60-46b3-b0ac-f815d9513001 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.514894 Jul 12 14:26:05.139745 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 14:26:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:26:06.107730 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:06.108729 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jul 12 14:26:06.109121 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:06.628226 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-2cf19913-ab6b-4d4b-a680-aaea6d27fb57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:26:06.647307 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-2cf19913-ab6b-4d4b-a680-aaea6d27fb57 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401937 Jul 12 14:26:06.647842 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Jul 12 14:26:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:26:07.613832 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:07.614876 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 12 14:26:07.615284 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:08.131580 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-277dd00d-1793-423a-96d8-b3b451c93e5f admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:08.150487 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-277dd00d-1793-423a-96d8-b3b451c93e5f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.399651 Jul 12 14:26:08.151008 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Jul 12 14:26:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:26:59.471489 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.472486 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-66cd2bf8-cf0c-41b8-a6bf-431554c29a3a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 12 14:26:59.472879 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:26:59.484000 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:59.859396 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-3587e35e-2ff2-4e87-8e1d-9014662f7ad4 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.878572 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-3587e35e-2ff2-4e87-8e1d-9014662f7ad4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399760 Jul 12 14:26:59.879102 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:26:59.901982 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-998b1040-b6d6-4fa0-87dd-52a9183ba177 admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.905381 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG dbcounter [-] [103405] Writing DB stats nova_api:SELECT=14 {{(pid=103405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:26:59.910918 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-998b1040-b6d6-4fa0-87dd-52a9183ba177 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012600 Jul 12 14:26:59.911430 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:26:59.923153 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-61336ab7-fe0c-4654-8791-5e7fe154569c admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.931007 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-61336ab7-fe0c-4654-8791-5e7fe154569c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011385 Jul 12 14:26:59.931504 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:26:59.943186 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.950686 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011017 Jul 12 14:26:59.951371 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:26:59.962105 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-5ccf7252-ff7f-4c94-ad87-61abe057440b admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:26:59.969743 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-5ccf7252-ff7f-4c94-ad87-61abe057440b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010963 Jul 12 14:26:59.970266 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Tue Jul 12 14:26:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:30:21.020816 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:21.021890 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Jul 12 14:30:21.022277 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:30:21.164384 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=6 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:30:21.321171 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:21.322381 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:30:21.322381 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:30:21.323584 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:21.324026 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:21.324810 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:21.325240 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:21.359562 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-e474daa9-aaf4-4012-8e16-04658a1258c9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.196557 Jul 12 14:30:21.360111 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:30:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:30:22.185071 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:22.186141 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 12 14:30:22.186560 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:30:22.376205 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:22.377483 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:30:22.377483 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:30:22.378662 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.379166 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.379942 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:22.380407 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:22.400587 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-07846d15-e237-48f0-96a0-53b4b51c2893 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076781 Jul 12 14:30:22.401170 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:30:22 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:30:33.660815 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:33.661899 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jul 12 14:30:33.662291 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:30:33.806043 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell0:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:30:33.807024 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_cell1:SELECT=4 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:30:33.807729 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG dbcounter [-] [103406] Writing DB stats nova_api:SELECT=8 {{(pid=103406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:30:33.856595 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:33.857818 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:30:33.857818 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:30:33.859046 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:33.859486 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:33.860322 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:33.860696 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:33.885126 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-83258ff7-bad8-411d-95f6-639cb6eaf773 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083546 Jul 12 14:30:33.885707 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:30:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:30:34.727463 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: DEBUG nova.api.openstack.wsgi [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] Calling method '>' {{(pid=103405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:34.728501 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: INFO nova.api.openstack.requestlog [None req-87c1241b-244c-43d2-88c1-9c4966297e3e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 12 14:30:34.728887 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: [pid: 103405|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Jul 12 14:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:30:34.924772 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG nova.api.openstack.wsgi [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] Calling method '>' {{(pid=103406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:30:34.926535 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:30:34.926535 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: warnings.warn(msg) Jul 12 14:30:34.927735 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:34.928176 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:34.928994 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:30:34.929447 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: DEBUG oslo_concurrency.lockutils [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:30:34.951942 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: INFO nova.api.openstack.requestlog [None req-ca7f9699-9398-491a-a7c6-01517c5fff4d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078328 Jul 12 14:30:34.952449 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: [pid: 103406|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Jul 12 14:30:34 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:31:32.139162 dv-cinder-836996-39-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 14:31:32.139776 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: Tue Jul 12 14:31:32 2022 - graceful shutdown triggered... Jul 12 14:31:32.140221 dv-cinder-836996-39-iscsi devstack@n-api.service[103405]: Gracefully killing worker 1 (pid: 103405)... Jul 12 14:31:32.140591 dv-cinder-836996-39-iscsi devstack@n-api.service[103406]: Gracefully killing worker 2 (pid: 103406)... Jul 12 14:31:33.140925 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: worker 1 buried after 1 seconds Jul 12 14:31:33.140925 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: worker 2 buried after 1 seconds Jul 12 14:31:33.140925 dv-cinder-836996-39-iscsi devstack@n-api.service[103404]: goodbye to uWSGI. Jul 12 14:31:33.143045 dv-cinder-836996-39-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 14:31:33.143585 dv-cinder-836996-39-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 14:31:33.146364 dv-cinder-836996-39-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 14:31:33.155742 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:31:33 2022] *** Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: nodename: dv-cinder-836996-39-iscsi Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: machine: x86_64 Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: clock source: unix Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: pcre jit disabled Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: detected number of CPU cores: 4 Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: current working directory: / Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:31:33.157730 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: your processes number limit is 47680 Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: your memory page size is 4096 bytes Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: detected max file descriptor number: 2048 Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: lock engine: pthread robust mutexes Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: thunder lock: enabled Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 14:31:33.159165 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:31:33.202779 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: Python main interpreter initialized at 0x5648328469c0 Jul 12 14:31:33.202779 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: python threads support enabled Jul 12 14:31:33.202779 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: your server socket listen backlog is limited to 100 connections Jul 12 14:31:33.202779 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:31:33.203225 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:31:33.203225 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: *** Operational MODE: preforking *** Jul 12 14:31:33.203518 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:31:33.203518 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: spawned uWSGI master process (pid: 124538) Jul 12 14:31:33.203724 dv-cinder-836996-39-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 14:31:33.209392 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: spawned uWSGI worker 1 (pid: 124549, cores: 1) Jul 12 14:31:33.209392 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: spawned uWSGI worker 2 (pid: 124550, cores: 1) Jul 12 14:31:33.209392 dv-cinder-836996-39-iscsi devstack@n-api.service[124538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:31:33.865842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:31:33.874012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 14:31:35.072640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:31:35.072640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: from cryptography.utils import int_from_bytes Jul 12 14:31:35.073308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:31:35.073308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: from cryptography.utils import int_from_bytes Jul 12 14:31:35.077477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:31:35.077477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: from cryptography.utils import int_from_bytes Jul 12 14:31:35.077943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:31:35.077943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: from cryptography.utils import int_from_bytes Jul 12 14:31:37.427732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:31:37.428366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:31:37.428568 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:31:37.428928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:31:37.429191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:31:37.429634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.429979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.430291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.430613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.430949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.431267 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.431597 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.432166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.432499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.432766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.433086 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.433192 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:31:37.433568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:31:37.433652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-39-iscsi {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.433841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.433953 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:31:37.434103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.434260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:31:37.434359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.434521 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:31:37.434683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.434905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435024 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.435865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.436101 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.436227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.437650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.437798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.437883 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.438368 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.438625 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.438836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.439083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.439419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.439660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.439895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.440102 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.440318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.440535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-39-iscsi {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.440766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.440983 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.441196 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.441412 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.441660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.441884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.442099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.442340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.442552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-39-iscsi {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.442774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.442958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.443999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444501 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444645 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444787 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.444942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445243 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445418 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445574 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.445922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446210 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.446961 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.447147 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.447296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-39-iscsi {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.447449 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.448597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.448770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.448926 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449280 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.449928 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.450070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.450218 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.450372 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.450522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.451249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.451429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.451579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.451736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.451891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452479 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.452937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453240 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453421 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.453865 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454155 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454460 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.454901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.455939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.456999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.457147 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.457296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.457481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.457627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.457778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.458478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.458894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.459926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460234 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460386 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460684 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460684 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.460960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461264 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.461942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462093 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462529 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462679 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462838 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.462994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463287 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463598 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463748 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.463977 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464272 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464414 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464555 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464703 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.464862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465167 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465635 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.465930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466381 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.466948 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467097 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467699 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.467990 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.468670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469025 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469486 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469641 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.469946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.470099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.470249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.470893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471043 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471773 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.471915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472062 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.472968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473258 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.473895 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474044 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474406 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.474929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.475969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476112 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.476862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477301 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477637 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477780 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.477930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.478078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.478734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.478906 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479713 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.479864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.480162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.480305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.480448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.480589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.480738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.480894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.481054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.481204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.481365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.481524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.481675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.481826 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.481976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.482124 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.482284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.482427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.482577 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.482726 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.482726 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.483024 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.483166 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.483307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.483457 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:31:37.483599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.483748 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.483890 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484033 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.484907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.485971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.486156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.486873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.487099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.488914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.489111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.489472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.489644 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.489799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.489944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490095 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490240 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490541 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.490985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491147 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491290 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491741 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.491883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492473 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.492927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493806 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.493967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494120 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494703 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494844 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.494999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.495904 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496336 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496629 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496779 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.496942 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497232 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497401 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497850 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.497992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.498133 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.498275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.498446 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499006 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499168 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499830 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.499982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500545 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.500988 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501505 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501694 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.501999 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502148 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502301 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.502903 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503343 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.503952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504101 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504407 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.504974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505681 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.505984 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506147 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506451 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506605 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.506901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.507670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.508103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.508262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.508262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.508551 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.509115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.509279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.509465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.509632 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.509967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510288 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.510882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511043 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511518 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511822 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.511993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512292 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.512920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.513901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514207 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.514974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515122 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515269 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515416 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515577 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.515892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516048 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.516945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.517093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.517369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.517554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.517715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.517864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518618 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.518773 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.519310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.519475 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.519640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520287 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520770 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.520932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521303 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.521972 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522437 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522593 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.522921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.523916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.524998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525155 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525636 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.525936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526387 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.526873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.527952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528109 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528428 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.528891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.529500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.529500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.529945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.530300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.530464 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.530621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.530769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.530927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531075 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.531863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.532759 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.533438 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.533601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.533763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.533913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534070 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534388 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534537 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.534840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535456 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535612 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.535932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.536097 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.536246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.536494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.536649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.536849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537029 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537372 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.537996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.538152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.538311 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.538467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.538623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.538786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.539077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.539607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.539773 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.539923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.540071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.540248 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.540503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.540750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.540913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541406 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.541858 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542334 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542483 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542645 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.542964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543286 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543446 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543752 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.543900 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544219 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544368 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.544969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545781 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.545939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.546842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.547002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.547150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.547348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.547509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.549727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.549922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.550081 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.550248 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.550399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.550665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.550947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551118 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551598 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.551903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552052 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552256 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.552958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553272 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553644 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553804 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.553955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554583 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.554890 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555054 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555719 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.555876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.556034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.556191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.556350 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.556519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.556677 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557232 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.557967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.558874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.559022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.559171 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.559333 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.559939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.560312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.560487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.560664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.560925 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.561182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.561610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.561772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.561936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562408 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562545 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562828 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.562981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563131 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563704 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563844 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.563993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564133 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564582 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564729 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.564898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565044 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565746 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565837 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.565928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566194 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566285 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566738 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.566996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.567970 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568109 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568234 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568514 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568598 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.568954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.569045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.569135 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.569217 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.569299 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.570943 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571575 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.571922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572277 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572536 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572628 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572714 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572804 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.572969 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573616 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573700 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.573871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574285 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574384 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574574 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.574929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575361 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.575914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576426 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.576972 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577062 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577612 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577793 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577882 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.577966 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578148 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578477 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578583 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.578914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579003 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.579694 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.581984 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.582714 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.582851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.582976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583209 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.583913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584501 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.584825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585697 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.585949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586124 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586207 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586333 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586533 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.586898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587793 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.587918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588694 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.588936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.589958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590622 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590748 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.590979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591433 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.591770 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592055 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592773 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.592883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593001 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.593921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.594978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595748 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.595924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596004 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.596876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597565 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.597923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598250 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.598860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.599905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600055 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600220 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.600962 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601044 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.601921 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.602983 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603742 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603833 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603916 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.603999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604171 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604243 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604449 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604763 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.604991 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605358 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605635 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.605901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606217 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606441 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.606839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607067 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607173 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607400 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607708 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.607799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608716 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.608932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.609967 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610583 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.610907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.611641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.611784 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.611944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612285 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612635 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.612930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.613930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614141 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614452 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614758 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.614896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615369 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.615998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616428 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.616935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617396 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.617993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.618206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.618306 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.618523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.618615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.618863 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619408 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.619811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620653 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.620961 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621630 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621888 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.621983 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.622220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.622341 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.622540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.622652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.622902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.623934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.624282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.624678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625349 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.625983 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.626274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.626385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.626622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.626768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.627529 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.627637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.627871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.627987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.628954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.629192 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.629296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.629681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.629813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630001 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.630831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631424 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.631919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.632180 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.632277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.632513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.632696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.632833 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633404 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633524 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.633829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.634136 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.634276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.634467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.634715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.634832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635764 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.635874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.636084 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.636187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.636465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.636614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.636922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637021 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637242 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.637908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638011 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638533 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638641 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.638968 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639802 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.639936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.640117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.640258 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.640425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.640752 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.640845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641514 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.641829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.642976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643526 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643837 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.643930 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644159 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644580 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.644974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.645958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646345 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.646973 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647303 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647405 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647756 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.647965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648384 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648585 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648680 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648891 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.648986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.649197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.649291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.649558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.649654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.649879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650293 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650498 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.650916 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651733 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.651842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652467 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.652988 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.653162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.653312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.653582 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.653739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.653905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.654931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655624 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.655950 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.656183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.656380 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.656535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.656715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.656857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.657038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.657392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.657533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.657727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.657840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658220 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658412 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.658999 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.659278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.659597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.659858 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660159 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.660950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661464 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661629 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.661950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662752 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.662913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663380 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663539 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.663926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664408 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664713 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.664878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665040 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665398 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665671 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.665904 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666086 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666248 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666352 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666638 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.666914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667194 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.667974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.668233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.668388 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.668533 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.668676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.668855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669001 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669518 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.669841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.670022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.670178 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.670480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.670739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.670843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671431 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.671925 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.672206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.672413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.672576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.672746 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.672896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.673153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.673298 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.673494 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.674177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.674329 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.674644 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.674811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675049 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.675983 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.676131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.676383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.676548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.676701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.676850 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677391 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677722 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.677868 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678074 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.678996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679604 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.679909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680361 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.680955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.681136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.681247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.681468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.681571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.681769 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682127 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682421 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682635 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.682946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.683865 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.684995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.685157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.685480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.685612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.685796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.685970 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.686136 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.686278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.686422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.686573 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.686744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.687227 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.687377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.687552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.687697 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.687870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688020 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688168 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688472 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688805 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.688954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.689119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.689419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.689641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.689861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.689861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.690323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.690529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.690824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.690981 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691580 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.691874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692283 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692537 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.692795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.693992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694093 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694311 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694422 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.694934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695416 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.695900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696001 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696331 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696545 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696877 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.696985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.697188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.697288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.697517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.697624 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.697766 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:31:37.697868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.698215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.698549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.698869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.699185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.699494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:31:37.699742 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:31:37.855442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Registered counter for database nova_api Jul 12 14:31:37.860219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO dbcounter [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Registered counter for database nova_api Jul 12 14:31:37.877108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.881600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.887406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:37.888878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writer thread running {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:37.946113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.context [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8(cell1) {{(pid=124550) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:31:37.947680 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.context [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8(cell1) {{(pid=124549) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 14:31:37.950213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:31:37.951762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:31:37.951891 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:31:37.952684 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:31:37.953401 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:31:37.954228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:31:37.954672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:31:37.956220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:31:37.956731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Registered counter for database nova_cell0 Jul 12 14:31:37.958326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO dbcounter [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Registered counter for database nova_cell0 Jul 12 14:31:37.960987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Registered counter for database nova_cell1 Jul 12 14:31:37.962276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO dbcounter [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Registered counter for database nova_cell1 Jul 12 14:31:37.968517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.970305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.972371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.973586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:37.979837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writer thread running {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:37.979976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:37.981485 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:38.117021 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writer thread running {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:38.127256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO dbcounter [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Registered counter for database nova_cell0 Jul 12 14:31:38.127432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO dbcounter [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Registered counter for database nova_cell0 Jul 12 14:31:38.134061 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_db.sqlalchemy.engines [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:38.137703 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:31:38.138597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writer thread running {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:38.142346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writer thread running {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:31:38.462880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: WARNING keystonemiddleware.auth_token [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:31:38.466215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:31:38.470422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: WARNING keystonemiddleware.auth_token [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:31:38.473576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:31:38.815099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: WARNING keystonemiddleware.auth_token [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:31:38.816695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 14:31:38.821238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: WARNING keystonemiddleware.auth_token [None req-8dc7b645-4cd1-4333-902e-125f42d438ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:31:38.823007 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: WARNING keystonemiddleware.auth_token [None req-7780e1bd-f3c2-4156-a1d0-701b9fb08ea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 14:31:38.826686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648328469c0 pid: 124549 (default app) Jul 12 14:31:38.828476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5648328469c0 pid: 124550 (default app) Jul 12 14:32:24.965497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9996b1ea-0f8f-42fc-91f5-e4c1647a5f3c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d0a6f1f0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:25.027917 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:25.029301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:25.039221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:25.040112 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:26.252062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9996b1ea-0f8f-42fc-91f5-e4c1647a5f3c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/622db520-7ae9-4fcf-bc98-4ad5bed54603" status: 200 len: 351 microversion: 2.1 time: 2.011030 Jul 12 14:32:26.257054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 1/1] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:32:24 2022] GET /compute/v2.1/os-volumes/622db520-7ae9-4fcf-bc98-4ad5bed54603 => generated 351 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:28.515826 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.518025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.519287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.522865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.541297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ff47a986-57c7-4d0a-9a45-79c14fe3aba4 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d08e7550>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:28.662547 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ff47a986-57c7-4d0a-9a45-79c14fe3aba4 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0ccaad28-6319-40e6-b4ca-7bf153c9a84a" status: 200 len: 351 microversion: 2.1 time: 0.125625 Jul 12 14:32:28.663393 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:32:28 2022] GET /compute/v2.1/os-volumes/0ccaad28-6319-40e6-b4ca-7bf153c9a84a => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:32:29.776111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8b1c790-bf98-4818-844f-9c91af051ebb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: .version_select at 0x7f01d09c05e0>, body: {"keypair": {"name": "tempest-keypair-467216431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWhp5u/GUldWpwX7Bf92O6V6ABqmO/5+FnGgWupTs7zBKI9dQn7zZBcAXsFXeJ7dHYWthDzE4yWQ1TupKqgs5UuYbL36CAxA3z2cMnl9hc0BzvRWqSZ+X4GDIq/Fj0SSA=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:29.893612 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-c8b1c790-bf98-4818-844f-9c91af051ebb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:32:29.902858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-c8b1c790-bf98-4818-844f-9c91af051ebb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:32:30.006441 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c8b1c790-bf98-4818-844f-9c91af051ebb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.496277 Jul 12 14:32:30.007696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:32:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:30.658646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d4c4ae20-5e0e-4977-8535-1a765b03fece tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d08e75e0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:30.768723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d4c4ae20-5e0e-4977-8535-1a765b03fece tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3d0ee94c-45a1-44a4-a842-cf861d68d396" status: 200 len: 351 microversion: 2.1 time: 0.115065 Jul 12 14:32:30.769302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:32:30 2022] GET /compute/v2.1/os-volumes/3d0ee94c-45a1-44a4-a842-cf861d68d396 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:30.791955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e5c2e769-3791-460d-8be7-e1d8d665a755 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d0884700>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:31.925491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e5c2e769-3791-460d-8be7-e1d8d665a755 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 1.148122 Jul 12 14:32:31.933380 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 2/5] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 12 14:32:30 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:31.939797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fb6f8387-ff58-4eac-93d8-ce8a9b302d33 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d08e7d30>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:32.112658 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fb6f8387-ff58-4eac-93d8-ce8a9b302d33 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.177798 Jul 12 14:32:32.113552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1148 bytes} [Tue Jul 12 14:32:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:32.130033 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a52580c7-caa7-4c36-849d-a373227faf89 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01cbfeb550>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:32.327497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a52580c7-caa7-4c36-849d-a373227faf89 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.202990 Jul 12 14:32:32.335255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1133 bytes} [Tue Jul 12 14:32:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:32.339945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e7d26274-91e4-4763-9ebf-c978be85f8bd tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d08e7e50>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:32.514755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e7d26274-91e4-4763-9ebf-c978be85f8bd tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.178673 Jul 12 14:32:32.515795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1166 bytes} [Tue Jul 12 14:32:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:32.529848 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0f22887a-3ad3-41ed-9f70-ec847c9b9ec0 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01cbffe1f0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:32.802482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0f22887a-3ad3-41ed-9f70-ec847c9b9ec0 tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.276684 Jul 12 14:32:32.803315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1169 bytes} [Tue Jul 12 14:32:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:32.819289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6bf217a8-0e76-4c32-beac-45b482e2ca8d tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d08951f0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:32.993608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6bf217a8-0e76-4c32-beac-45b482e2ca8d tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.178034 Jul 12 14:32:32.995245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 12 14:32:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:33.008233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e4273e87-a3f3-41a1-ad15-af48f960950c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01cbfebc10>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:33.238923 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e4273e87-a3f3-41a1-ad15-af48f960950c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.236449 Jul 12 14:32:33.239918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1187 bytes} [Tue Jul 12 14:32:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:33.253088 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-118abd3c-eb84-4b6a-a274-53f158830c3c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] Calling method '.version_select at 0x7f01d0895e50>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:33.462544 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-118abd3c-eb84-4b6a-a274-53f158830c3c tempest-VolumesTestJSON-1888282409 tempest-VolumesTestJSON-1888282409-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.213245 Jul 12 14:32:33.463415 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1154 bytes} [Tue Jul 12 14:32:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:35.079270 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-24855525", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "networks": [{"uuid": "48adf0ff-ed8a-47b1-b548-3b033b3653be"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:35.249119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] validate_networks() for [('48adf0ff-ed8a-47b1-b548-3b033b3653be', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:32:35.793176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498720291", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d70325-149a-4db6-bab3-e97d17656939"}], "security_groups": [{"name": "tempest-securitygroup--952003937"}], "key_name": "tempest-keypair-467216431", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:36.368434 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] validate_networks() for [('81d70325-149a-4db6-bab3-e97d17656939', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:32:38.282442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:32:38.282988 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:32:38.283409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:32:38.283776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:32:38.284474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:32:38.299071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:38.299871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:38.303264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:38.304938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:38.357163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Getting quotas for project bd2e10a0973e431db6cc11cc924fd826. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:32:38.361660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Getting quotas for user d1ac1cdd046a4ae4b9f41b75d347d997 and project bd2e10a0973e431db6cc11cc924fd826. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:32:38.374480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:32:38.378510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:32:38.476224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bf630992-803a-4996-b1f1-b3a67b6db046 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.695561 Jul 12 14:32:38.477557 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 6/13] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:32:38.489436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-db0bd1b3-1873-4138-b3b5-fbead1ecf481 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:38.490365 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-db0bd1b3-1873-4138-b3b5-fbead1ecf481 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:38.755670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-db0bd1b3-1873-4138-b3b5-fbead1ecf481 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:38.779961 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-db0bd1b3-1873-4138-b3b5-fbead1ecf481 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1213 microversion: 2.1 time: 0.295145 Jul 12 14:32:38.780550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:38 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1213 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:32:39.765920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:32:39.767816 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:32:39.768724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:32:39.777157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:32:39.778677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:32:39.809836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-11a7a186-959d-4ffa-b76b-608b805b952e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: .version_select at 0x7f01cbf3f8b0>, body: {"keypair": {"name": "tempest-keypair-688859604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAIjDkGnomEKQiZv/51BNSpim3mEqmvhJDxeXtjT/UBRZxSOFqk/654C7TFeMoGlkLS+cgkYInjHwYs1uBWN3Ixwu1IV8St2cFw1Ybl0UgH7NidQjTG9SPPNsgZvNNFpA=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:39.813040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:39.813661 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:39.815038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:39.815704 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:39.849931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-11a7a186-959d-4ffa-b76b-608b805b952e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:32:39.859025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-11a7a186-959d-4ffa-b76b-608b805b952e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for user 3753498f22d5443ab0c01473c91a263c and project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:32:39.893408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:32:39.911543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:32:39.948258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:32:39.959258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:32:39.966505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-11a7a186-959d-4ffa-b76b-608b805b952e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.033310 Jul 12 14:32:39.973693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 8/15] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 12 14:32:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1042 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 14:32:39.988588 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7bafaef1-5917-4616-950a-eb52420890bc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:39.996626 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7bafaef1-5917-4616-950a-eb52420890bc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:40.206803 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7bafaef1-5917-4616-950a-eb52420890bc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:40.218585 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7bafaef1-5917-4616-950a-eb52420890bc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1213 microversion: 2.1 time: 0.243623 Jul 12 14:32:40.222091 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:39 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:40.285988 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-be796100-ea51-4e25-af9d-d873236ed554 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.504802 Jul 12 14:32:40.288427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 8/17] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:32:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 4508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:32:40.299241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93a21e9a-0411-4600-99a7-2fcb3688a7bb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:40.299871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93a21e9a-0411-4600-99a7-2fcb3688a7bb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:40.504183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93a21e9a-0411-4600-99a7-2fcb3688a7bb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:40.531833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93a21e9a-0411-4600-99a7-2fcb3688a7bb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1241 microversion: 2.1 time: 0.237724 Jul 12 14:32:40.532691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 10/18] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:40 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:41.239567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71bacb10-66f6-42f6-bb22-ae1b9e43b37c tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:41.240278 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-71bacb10-66f6-42f6-bb22-ae1b9e43b37c tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:41.473421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-71bacb10-66f6-42f6-bb22-ae1b9e43b37c tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:41.510999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-71bacb10-66f6-42f6-bb22-ae1b9e43b37c tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1213 microversion: 2.1 time: 0.272223 Jul 12 14:32:41.523404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 9/19] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:41 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:41.551142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ac274d2-f05c-4ba9-9219-9bf349e95bb8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:41.552569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0ac274d2-f05c-4ba9-9219-9bf349e95bb8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:41.742287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0ac274d2-f05c-4ba9-9219-9bf349e95bb8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:41.751292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ac274d2-f05c-4ba9-9219-9bf349e95bb8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1241 microversion: 2.1 time: 0.206185 Jul 12 14:32:41.762413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 11/20] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:41 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:42.529563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:42.532737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:42.550596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:42.551025 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:42.560554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:42.563385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:42.769246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:42.769955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:42.785702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:42.786164 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:42.786979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:42.787405 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:43.093202 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:43.128110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d6d3eb18-f00b-4060-b7d7-1102993948c0 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1265 microversion: 2.1 time: 0.600015 Jul 12 14:32:43.129855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:42 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1265 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:43.312199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:43.324538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-94ec7b3d-b384-4a42-b672-dcf0d27c734a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1237 microversion: 2.1 time: 0.559160 Jul 12 14:32:43.325707 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 12/22] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:42 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1237 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:43.620159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-338964191", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06565c91-0787-49b2-b9d2-af1832defa90"}], "security_groups": [{"name": "tempest-securitygroup--854931485"}], "key_name": "tempest-keypair-688859604", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:44.114722 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] validate_networks() for [('06565c91-0787-49b2-b9d2-af1832defa90', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:32:44.448283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5f6b0d2d-0e91-436b-b526-10cebe2062f3 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Action: 'create', calling method: .version_select at 0x7f01caed4940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-28210115", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5f6b0d2d-0e91-436b-b526-10cebe2062f3 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 120 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:44.485941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-28210115", "metadata": {"Type": "work"}}} Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:44.487306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-28210115', 'metadata': {'Type': 'work'}}}} Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:44.488186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:32:44.489495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:32:44.490620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 14:32:44.490620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:44.492033 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5f6b0d2d-0e91-436b-b526-10cebe2062f3 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:44.493295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5f6b0d2d-0e91-436b-b526-10cebe2062f3 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.767965 Jul 12 14:32:44.494443 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 13/23] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 14:32:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 770 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:32:44.504986 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:44.508964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:44.527732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:44.528879 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:44.531788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:44.532486 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:44.874145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:44.896295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-436194bd-8b39-43f2-8209-e3505bec94dd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1271 microversion: 2.1 time: 0.400069 Jul 12 14:32:44.896832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:44 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1271 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:44.911273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:44.911909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:44.933465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:44.934261 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:44.935227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:44.939901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:45.288448 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:45.309265 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8b35fe43-d3b9-4da2-9817-148f26d4578e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1299 microversion: 2.1 time: 0.411310 Jul 12 14:32:45.309885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 15/25] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:44 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1299 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:45.354580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfa2406a-0294-4d27-85bd-47faf72ca53c tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Action: 'create', calling method: .version_select at 0x7f01cadc21f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-459996184", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfa2406a-0294-4d27-85bd-47faf72ca53c tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 119 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:45.367701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-459996184", "metadata": {"Type": "work"}}} Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:45.368910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-459996184', 'metadata': {'Type': 'work'}}}} Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '0' Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:45.370179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:32:45.371489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:32:45.374464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 14:32:45.374464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.374464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfa2406a-0294-4d27-85bd-47faf72ca53c tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:45.374464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfa2406a-0294-4d27-85bd-47faf72ca53c tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038333 Jul 12 14:32:45.381745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 16/26] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 14:32:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:32:45.386560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a46b782f-f005-4910-8d2b-6391a309035b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Action: 'create', calling method: .version_select at 0x7f01cae50700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1446880059", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a46b782f-f005-4910-8d2b-6391a309035b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 119 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:45.405806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1446880059", "metadata": {"Type": "work"}}} Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:45.407209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1446880059', 'metadata': {'Type': 'work'}}}} Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise error Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi '' Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:45.408010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 14:32:45.409344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 14:32:45.410543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 14:32:45.410543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.412929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a46b782f-f005-4910-8d2b-6391a309035b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:45.419540 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a46b782f-f005-4910-8d2b-6391a309035b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034512 Jul 12 14:32:45.427864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 17/27] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 14:32:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:32:45.463303 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2506374c-2f97-4257-bbd3-3befb89d5b6b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Calling method '.version_select at 0x7f01cae50430>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:45.518377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-2506374c-2f97-4257-bbd3-3befb89d5b6b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] HTTP exception thrown: Volume tempest-invalid-1794450692 could not be found. Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2506374c-2f97-4257-bbd3-3befb89d5b6b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1794450692 HTTP/1.1 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:45.522119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume tempest-invalid-1794450692 could not be found. Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'tempest-invalid-1794450692'} Jul 12 14:32:45.523244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1794450692 could not be found. (HTTP 404) (Request-ID: req-6f59ce67-2062-4e69-970b-40f2bd8af506) Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.524059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:32:45.525014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1794450692 could not be found. Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:45.528561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1794450692 could not be found. Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1794450692 could not be found. Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2506374c-2f97-4257-bbd3-3befb89d5b6b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 404 to user: Volume tempest-invalid-1794450692 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:45.531828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2506374c-2f97-4257-bbd3-3befb89d5b6b tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1794450692" status: 404 len: 99 microversion: 2.1 time: 0.094567 Jul 12 14:32:45.533616 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 18/28] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 14:32:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1794450692 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:32:45.556640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5b30ea3f-f05a-4cb9-8d04-f5c6ac991c76 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016279 Jul 12 14:32:45.559600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 19/29] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 12 14:32:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 14:32:45.570082 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5d8aa921-df9a-422c-bb02-0c9dfac5f2ac tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003797 Jul 12 14:32:45.590800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 20/30] 10.222.0.25 () {58 vars in 1136 bytes} [Tue Jul 12 14:32:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 14:32:45.599602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0ff2dbb-e59e-4d63-941e-5f2ced272a91 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Calling method '.version_select at 0x7f01cadd5790>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:45.697616 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-b0ff2dbb-e59e-4d63-941e-5f2ced272a91 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] HTTP exception thrown: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0ff2dbb-e59e-4d63-941e-5f2ced272a91 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/os-volumes/2f437954-4db0-4eeb-8d55-79f5bcb8b043 HTTP/1.1 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:45.699553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '2f437954-4db0-4eeb-8d55-79f5bcb8b043'} Jul 12 14:32:45.700593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. (HTTP 404) (Request-ID: req-3d0805ea-912c-4410-8a62-0f53d548362d) Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.701235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:32:45.704108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:32:45.705640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0ff2dbb-e59e-4d63-941e-5f2ced272a91 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 404 to user: Volume 2f437954-4db0-4eeb-8d55-79f5bcb8b043 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b0ff2dbb-e59e-4d63-941e-5f2ced272a91 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/2f437954-4db0-4eeb-8d55-79f5bcb8b043" status: 404 len: 109 microversion: 2.1 time: 0.108915 Jul 12 14:32:45.706555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 21/31] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:32:45 2022] DELETE /compute/v2.1/os-volumes/2f437954-4db0-4eeb-8d55-79f5bcb8b043 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:32:45.710655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-023649ba-2db8-4955-978a-bad9ac17bad6 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Calling method '.version_select at 0x7f01cadd5f70>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:45.807884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-023649ba-2db8-4955-978a-bad9ac17bad6 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] HTTP exception thrown: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-023649ba-2db8-4955-978a-bad9ac17bad6 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Request method failure captured: Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/ddcc36bd-209a-44af-b3bc-51da3f054bc3 HTTP/1.1 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYLdRfQdbQG8LLMQycSzangu18sehe70j4NudpaXB5eGjdkWohr0CC9UQUH_XK3AvLa3HWA4zR8Ou_89tOoVIVAbEV7PCED_0ToKg4TDStJB6J-koNvuopEQ8rEy49fXxgs1l5o529npHZuNSZ7IkgKiW2v4TbfICUBuUvXUsq_SjA Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:32:45.810030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7112897d6524ad48391981ab7252359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7112897d6524ad48391981ab7252359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7112897d6524ad48391981ab7252359", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: d7112897d6524ad48391981ab7252359 Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1949548684 Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 1b4c9cf34d1f44d191a93d3eb275879f Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1949548684-project Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'ddcc36bd-209a-44af-b3bc-51da3f054bc3'} Jul 12 14:32:45.811183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. (HTTP 404) (Request-ID: req-d76eef5e-4001-4754-a427-4ed8ea672521) Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.811977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:32:45.812932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:32:45.813870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. Jul 12 14:32:45.814856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:32:45.817711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-023649ba-2db8-4955-978a-bad9ac17bad6 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] Returning 404 to user: Volume ddcc36bd-209a-44af-b3bc-51da3f054bc3 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:32:45.818783 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-023649ba-2db8-4955-978a-bad9ac17bad6 tempest-VolumesNegativeTest-1949548684 tempest-VolumesNegativeTest-1949548684-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ddcc36bd-209a-44af-b3bc-51da3f054bc3" status: 404 len: 109 microversion: 2.1 time: 0.112036 Jul 12 14:32:45.828536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 22/32] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:32:45 2022] GET /compute/v2.1/os-volumes/ddcc36bd-209a-44af-b3bc-51da3f054bc3 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:32:45.914092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:45.914810 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:45.933872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:45.942459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:45.944754 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:45.950952 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:47.004938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:47.015268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-aa2f471b-8b22-4470-8807-bd0dcf37a32e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 1.105534 Jul 12 14:32:47.015931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 23/33] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:45 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:32:47.025083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:47.025083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:47.049072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:47.049652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:47.050466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:47.051223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:47.052735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:32:47.053248 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:32:47.053917 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:32:47.054701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:32:47.055859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:32:47.069932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:47.070289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:47.071261 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:47.072286 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:47.122885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:32:47.140384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for user 3753498f22d5443ab0c01473c91a263c and project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:32:47.201303 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:32:47.211181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:32:47.371183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2a7d6b79-5641-4053-ac7e-9a6ed796a5c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.763906 Jul 12 14:32:47.378807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 11/34] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 12 14:32:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3771 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 14:32:47.396535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:47.398441 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:47.649685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:47.666275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-508dd452-b392-4cd2-85b5-1d98104996c8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.641664 Jul 12 14:32:47.669213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 24/35] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:47 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:47.748435 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:47.772995 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:47.786409 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:47.789038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6d7cab1b-61ea-4b10-b308-81cfdd4bf9d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1280 microversion: 2.20 time: 0.406756 Jul 12 14:32:47.790353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 12/36] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:47 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1280 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:48.043745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:48.045682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:48.076140 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:48.077323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:48.080759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:48.084647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:48.341901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:48.686622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:48.688646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:48.712307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:48.718291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:48.725360 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:48.725878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:49.392683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:49.437119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-faf4151d-67a7-4d79-91bb-746a368be4df tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.742986 Jul 12 14:32:49.437119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 13/37] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:48 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:49.453173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:49.453824 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:49.463927 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:49.464294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:49.465070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:49.465561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:49.588315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:49.599512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-de756add-6092-4a56-ba97-af9f68382603 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 1.571315 Jul 12 14:32:49.600355 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 25/38] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:48 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:49.636242 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:49.654577 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:49.659580 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:49.669142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bf285a37-dd21-4457-95a9-dee5b95ba0f9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1332 microversion: 2.20 time: 0.237666 Jul 12 14:32:49.671293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 14/39] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:49 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1332 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:50.448486 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:50.449445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:50.469478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:50.472390 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:50.473269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:50.475811 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:50.852096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-49300431-8210-48ce-9c87-21c9c80416e9 req-4aa7b08e-6d1f-4a1b-b242-4885d2e57b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a632d5e0-9cae-4a5d-9607-4b8f91601de6", "tag": "54c4615b-3a44-4b7d-a5d9-a95f0077ce44"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:50.905119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-49300431-8210-48ce-9c87-21c9c80416e9 req-4aa7b08e-6d1f-4a1b-b242-4885d2e57b43 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:50.906626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-49300431-8210-48ce-9c87-21c9c80416e9 req-4aa7b08e-6d1f-4a1b-b242-4885d2e57b43 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:50.950237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-49300431-8210-48ce-9c87-21c9c80416e9 req-4aa7b08e-6d1f-4a1b-b242-4885d2e57b43 service nova] Creating event network-changed:54c4615b-3a44-4b7d-a5d9-a95f0077ce44 for instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 on hv-cinder-83699 Jul 12 14:32:50.951181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-49300431-8210-48ce-9c87-21c9c80416e9 req-4aa7b08e-6d1f-4a1b-b242-4885d2e57b43 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 14:32:50.952551 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:50.953409 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:50.954812 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:50.955861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:50.983106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.compute.rpcapi [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 14:32:50.986643 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] Releasing lock "compute-rpcapi-router" {{(pid=124549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 14:32:51.038495 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0608fe19-aa8c-4f4b-9989-64f5d617631b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522479 Jul 12 14:32:51.039399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 15/40] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:51.045226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:51.048515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:51.081246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:51.084743 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:51.086193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:51.087464 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:51.457375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:51.473040 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-83ad7a51-f745-46ef-9dcd-b39d9504bda6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 1.028739 Jul 12 14:32:51.476615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 26/41] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:50 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:51.492389 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:51.493606 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:51.511126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:51.512801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:51.516063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:51.518178 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:51.747092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=22 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:51.749083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:51.760212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-49dbcfb8-9050-4ce2-a5c5-b819873c9b39 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.719422 Jul 12 14:32:51.760817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 16/42] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:51 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:52.122849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-b9f70c70-138f-43b6-ac95-4f690ed0e3ff req-1075ed41-6e2f-458f-a18f-f2db950d856b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223a3cd9-6088-4e3d-a21b-1430e2afb13b", "tag": "f593632b-dfcc-4876-8e84-2597e503eacd"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:52.140085 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-b9f70c70-138f-43b6-ac95-4f690ed0e3ff req-1075ed41-6e2f-458f-a18f-f2db950d856b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:52.146581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-b9f70c70-138f-43b6-ac95-4f690ed0e3ff req-1075ed41-6e2f-458f-a18f-f2db950d856b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:52.178917 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-b9f70c70-138f-43b6-ac95-4f690ed0e3ff req-1075ed41-6e2f-458f-a18f-f2db950d856b service nova] Creating event network-changed:f593632b-dfcc-4876-8e84-2597e503eacd for instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b on hv-cinder-83699 Jul 12 14:32:52.185156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:52.193881 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-b9f70c70-138f-43b6-ac95-4f690ed0e3ff req-1075ed41-6e2f-458f-a18f-f2db950d856b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420946 Jul 12 14:32:52.195038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 17/43] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:52.199263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:52.204503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:52.207721 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cebddb99-8d5a-411a-a767-579e2a43f7ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1338 microversion: 2.20 time: 0.725880 Jul 12 14:32:52.209190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 27/44] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:51 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1338 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:52.492693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:52.493553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:52.505638 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:52.506322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:52.507294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:52.511761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:52.780580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:52.781932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:52.791353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:52.791823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:52.792969 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:52.793568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:52.836379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:52.848020 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4376594c-485e-4edc-9e46-6af398fe8519 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.359413 Jul 12 14:32:52.851712 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 18/45] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:52 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:52.989713 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:53.002480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-90843fb2-eb78-4026-92c7-08b623da456a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.227715 Jul 12 14:32:53.005908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 28/46] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:52 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:53.228798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:53.229239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:53.248403 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:53.249302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:53.251096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:53.251549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:53.447061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:53.456734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:53.459414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:53.461606 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d74acd43-d3c3-4a6f-84eb-5f3103cb439e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.236675 Jul 12 14:32:53.462244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 19/47] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:53 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:53.873752 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:53.875823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:53.884862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:53.885691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:53.886953 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:53.887577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:54.023998 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:54.024796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:54.036291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:54.039562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:54.043991 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:54.044863 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:54.127341 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:54.136563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-faec7081-f43d-4ce2-9e90-d93983454ecc tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.271044 Jul 12 14:32:54.137751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 29/48] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:53 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:54.324056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:54.340078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5c86912a-a3f0-43cf-b27a-3ac54a19378b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.320738 Jul 12 14:32:54.342645 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 20/49] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:54 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:54.479969 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:54.480657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:54.502669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:54.503445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:54.504669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:54.505359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:54.773501 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:54.783339 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:54.797983 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:54.799378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-94d29ccf-4256-4f1c-86ec-af320c70d98c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.323750 Jul 12 14:32:54.815399 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 30/50] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:54 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:55.154408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:55.155364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:55.168270 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.168798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:55.172415 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.172900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:55.360753 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:55.362503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:55.375407 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.375873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:55.376667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.377121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:55.455292 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:55.480518 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d4b0ef84-82a4-4932-9e1f-b557751496b4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.329440 Jul 12 14:32:55.483479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 21/51] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:55 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:55.732821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:55.742731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-75cdb227-85eb-41b4-bcfd-374f9e1c5d69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.386431 Jul 12 14:32:55.745724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 31/52] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:55 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:55.823208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:55.824258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:55.834562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.841115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:55.846138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:55.850124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:56.485202 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:56.500597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:56.502007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:56.502320 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:56.505899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:56.511610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:56.512552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d390be12-d3a1-43a5-96d7-a1bc4d2b582b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.691593 Jul 12 14:32:56.514481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:56.514886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 22/53] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:55 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:56.522665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:56.523324 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:56.764325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:56.765024 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:56.776841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:56.786126 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:56.788185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:56.789273 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:56.899312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:56.916098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1563d1f2-8a7d-4353-9e93-d30fa2df50f8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.420577 Jul 12 14:32:56.917695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 32/54] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:56 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:32:57.372653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:57.395420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b0519ab5-38a9-4c2f-a8d0-030cd6779b48 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.629044 Jul 12 14:32:57.398485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 23/55] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:56 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:57.532589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:57.533174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:57.545167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:57.545650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:57.546468 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:57.546944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:57.818833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:57.830530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:57.833852 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:57.835411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d4c59211-3854-47b6-a519-513085863832 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.307548 Jul 12 14:32:57.836536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 33/56] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:57 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:57.935506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:57.936482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:57.940066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=16 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:57.951696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:57.962144 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:57.965273 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:57.965856 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.195976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-51809d1d-8ae0-45d8-8d0b-50925e5fd7a1 req-e823ad5c-1fd0-42eb-985a-33646b21ef04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:32:58.213262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-51809d1d-8ae0-45d8-8d0b-50925e5fd7a1 req-e823ad5c-1fd0-42eb-985a-33646b21ef04 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.214566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-51809d1d-8ae0-45d8-8d0b-50925e5fd7a1 req-e823ad5c-1fd0-42eb-985a-33646b21ef04 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.250905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-51809d1d-8ae0-45d8-8d0b-50925e5fd7a1 req-e823ad5c-1fd0-42eb-985a-33646b21ef04 service nova] Creating event network-changed:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:32:58.251717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-51809d1d-8ae0-45d8-8d0b-50925e5fd7a1 req-e823ad5c-1fd0-42eb-985a-33646b21ef04 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 14:32:58.253221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.254117 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.255368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.256034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.264041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:58.269028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.compute.rpcapi [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 14:32:58.270294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] Releasing lock "compute-rpcapi-router" {{(pid=124550) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 14:32:58.271582 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-264241a3-cb79-461d-8913-3a018583d081 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.342121 Jul 12 14:32:58.283646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 24/57] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:57 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:58.324550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a1897b5a-f8a5-4e83-be48-c469e3f38b19 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137429 Jul 12 14:32:58.325162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 34/58] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:32:58.415616 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:58.416457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:58.424489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.424948 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.426407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.427040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.583620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:58.585432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a490292f-18a6-42e5-bdd1-45307e827082 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.174227 Jul 12 14:32:58.586009 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 25/59] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:58 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:58.853981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:58.854689 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:58.856664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:58.862967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.863417 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.864182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:58.864613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:58.869290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=91 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:58.996923 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:59.005341 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:59.006886 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:59.007998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f81bfbd1-e741-45e2-9388-10649325fc29 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.158331 Jul 12 14:32:59.008564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 35/60] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:32:58 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:32:59.290222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:59.290844 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:59.296920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:59.297628 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:59.298521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:59.298954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:59.449532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:59.456993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-38401a36-e2eb-44d6-bed4-4dd85a58d0ce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.170704 Jul 12 14:32:59.457588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 26/61] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:59 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:32:59.603444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:32:59.604060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:32:59.611641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:59.612124 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:59.613693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:32:59.614144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:32:59.743103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:32:59.750417 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6a9bd67c-9797-460c-a652-adb716b93636 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.151743 Jul 12 14:32:59.750981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 36/62] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:32:59 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:00.026334 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:00.026924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:00.033458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.033905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.034664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.035100 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.191975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:00.201756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:00.204233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:00.205622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-00fef46c-4ff6-414f-b758-e6589cbfcb01 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.182980 Jul 12 14:33:00.206351 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 27/63] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:00 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:00.473998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:00.474614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:00.480732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.481182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.481986 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.482531 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.645687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:00.653047 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f8ff276b-8dbe-4093-9c3e-a7995bf571a7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.182927 Jul 12 14:33:00.653637 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 37/64] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:00 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:00.768342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:00.769137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:00.776142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.776775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.784759 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:00.785266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:00.970352 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:00.977636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:00.977636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:00.981942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ce7c90ae-afd4-4dd7-a4f9-d61e5e3a1731 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.218426 Jul 12 14:33:00.982579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 28/65] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:00 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:01.234846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:01.235504 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:01.241715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:01.242164 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:01.242941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:01.243379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:01.375827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:01.384564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:01.386110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:01.387216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0b7d356a-9647-4396-b9b6-2518df53a289 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.166447 Jul 12 14:33:01.387775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 38/66] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:01 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:01.672082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:01.672952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:01.680810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:01.681302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:01.682101 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:01.682996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:01.930189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:01.942179 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-97c17f8d-30eb-4c03-91c6-63866036be10 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.274874 Jul 12 14:33:01.946877 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 29/67] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:01 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:02.000567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:02.001796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:02.008473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.009273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:02.010263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.010875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:02.189538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:02.201985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0bc834e1-98d4-4ec6-ab6d-7be0f6862e4b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.205651 Jul 12 14:33:02.213957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 39/68] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:01 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:02.411478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:02.412448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:02.419276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.420690 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:02.422427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.423626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:02.631672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:02.644540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:02.646753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:02.648194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c995dab9-c8d5-4382-af0c-1b2148438556 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.245958 Jul 12 14:33:02.649374 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 30/69] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:02 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:33:02.970083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:02.970706 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:02.976583 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.977032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:02.977858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:02.978284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:03.135191 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:03.142658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1b6ae642-f061-42e7-af62-834755656a4b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.182715 Jul 12 14:33:03.143230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 40/70] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:02 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:03.220793 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:03.221454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:03.233366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:03.234785 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:03.235576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:03.236015 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:03.426336 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:03.436004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d618c959-4aba-4cdb-ab75-6dd8721ab01a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.219394 Jul 12 14:33:03.436836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 31/71] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:03 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:03.667619 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:03.668553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:03.675610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:03.676209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:03.677035 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:03.677488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:03.855105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:03.866840 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:03.868374 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:03.869505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e0c92c71-d283-4f1e-a25d-3f7162766770 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.206651 Jul 12 14:33:03.870295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 41/72] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:03 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:04.159827 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:04.160579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:04.166993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.167523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:04.168357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.169132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:04.313216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:04.324440 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-abddceda-88ba-4fce-a39b-add44961c111 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.168638 Jul 12 14:33:04.325012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 32/73] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:04 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:04.454058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:04.455287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:04.461791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.462260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:04.463014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.463473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:04.638805 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:04.648880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7adc8002-6ed3-4e2d-a5c3-7b354bcc0a0d tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.199107 Jul 12 14:33:04.650460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 42/74] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:04 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:04.889538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:04.890557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:04.898660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.899418 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:04.900647 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:04.901232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:05.193845 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:05.207867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:05.209355 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:05.217257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d50e49f3-4d7f-47f7-a859-13e9db7b62ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.330814 Jul 12 14:33:05.217906 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 33/75] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:04 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:33:05.341295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:05.342163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:05.349765 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:05.350439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:05.352068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:05.352307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:05.531681 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:05.540228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-87555141-26df-4dab-9e6e-d882254affdf tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.202771 Jul 12 14:33:05.550526 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 43/76] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:05 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:05.667630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:05.668255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:05.675802 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:05.676375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:05.677150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:05.677611 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:05.820077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:05.830323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-12143e35-17da-4e4d-a0f4-8255ffe39f4a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.167704 Jul 12 14:33:05.831102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 34/77] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:05 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:06.243617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:06.244664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:06.252096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.252596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:06.253760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.254376 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:06.400679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:06.414473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:06.416898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:06.418292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-aee5bb4f-25a4-4c7d-b2fd-fcd22e0c68fd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.181246 Jul 12 14:33:06.418987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 44/78] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:06 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:06.563130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:06.564251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:06.567099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:06.572535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.573013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:06.573814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.574251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:06.720666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:06.734010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ede0c42b-6b49-40b7-ac63-0a69a3f17ae7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.179853 Jul 12 14:33:06.735070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 35/79] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:06 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:06.850036 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:06.851246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:06.861299 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.862031 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:06.863198 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:06.863798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:07.060834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:07.070116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e06e1c1-5c21-4909-b1b8-d1d41eceb7fc tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.224554 Jul 12 14:33:07.077092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 45/80] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:06 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:07.436675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:07.438022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:07.444753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:07.445499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:07.446751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:07.447249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:07.607162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:07.616040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:07.619621 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:07.619621 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-66f998fb-b3de-40c6-a91a-0e6f02dc1bdf tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.186672 Jul 12 14:33:07.619621 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 36/81] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:07 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:33:07.750599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:07.751239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:07.757208 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:07.757701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:07.758461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:07.758896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:07.889424 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:07.898059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-443931a1-fb3c-474e-a3cf-fcbc38e489f7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.151345 Jul 12 14:33:07.898765 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 46/82] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:07 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:08.087603 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:08.088212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:08.094166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.094612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:08.095364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.095797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:08.253188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:08.260879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5c991dbb-1621-4f37-9f72-e550fce0820e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.177288 Jul 12 14:33:08.261463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 37/83] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:08 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:08.636162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:08.636775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:08.638675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:08.644849 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.644849 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:08.645589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.646075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:08.777077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:08.786020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:08.787727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:08.788831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-51650d4f-c75a-4784-a125-e1fa0fa5d4f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.156558 Jul 12 14:33:08.789413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 47/84] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:08 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:08.915702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:08.916312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:08.922986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.923450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:08.924203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:08.924633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:09.051362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:09.058896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fce172f8-4f94-43ef-8820-6023f810cea4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.147152 Jul 12 14:33:09.059460 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 38/85] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:08 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:09.278375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:09.281370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:09.292935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:09.294324 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:09.295617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:09.297485 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:09.307206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-771287533", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:09.378778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] validate_networks() for None {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:33:09.482919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:09.493915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c93e3a49-e286-479c-be65-bb63a208a5e4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.220181 Jul 12 14:33:09.497548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 48/86] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:09 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:09.809170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:09.810057 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:09.823379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:09.824027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:09.826575 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:09.827059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.034939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.044767 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.046996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.048377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c2224819-c74d-498a-b789-0c788459c9cc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.244558 Jul 12 14:33:10.049260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 49/87] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:09 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:10.076215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:10.078337 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:10.085214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.085709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.086489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.087086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.206335 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:33:10.206765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:33:10.207230 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:33:10.207637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:33:10.208043 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:33:10.218797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.219581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.220623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.220873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.229314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.238265 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8ca66732-8926-426a-a045-99d926b6c132 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.166108 Jul 12 14:33:10.238437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Getting quotas for project 553646e8f0884b22ba3e3d5c6b173d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:33:10.238861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 50/88] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:10 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:10.243113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Getting quotas for user ab229da11aac429698ad11d65aa58485 and project 553646e8f0884b22ba3e3d5c6b173d1b. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:33:10.255280 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:33:10.257573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:33:10.303834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a7ed9d38-72cc-4d90-bd36-255ee9984277 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000815 Jul 12 14:33:10.304549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 39/89] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:33:10.315582 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-43bc7c89-9454-4251-9194-ad0e8c4e9c84 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:10.316174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-43bc7c89-9454-4251-9194-ad0e8c4e9c84 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:10.373384 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-43bc7c89-9454-4251-9194-ad0e8c4e9c84 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.381903 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-43bc7c89-9454-4251-9194-ad0e8c4e9c84 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1214 microversion: 2.1 time: 0.070858 Jul 12 14:33:10.382910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 51/90] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:10 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:10.510779 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:10.511404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:10.518320 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.518985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.520030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:10.520633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:10.673426 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:10.682524 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a98ad352-d341-40e5-a17b-f9d6097e3e91 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.175524 Jul 12 14:33:10.684393 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 40/91] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:10 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:11.067367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:11.067979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:11.074261 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.074648 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.075412 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.075846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.255797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:11.256663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:11.263729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.264184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.265532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.265971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.381917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.384370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:11.393766 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.395738 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.397412 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54d83e6b-2ffd-49d5-ab7c-950083637cee tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.333902 Jul 12 14:33:11.398169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 52/92] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:11 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:11.419581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:11.421026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:11.430251 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.430794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.431648 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.432308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.510806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.518947 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8b470a72-5754-453b-a9d4-98f7b3177f27 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1218 microversion: 2.1 time: 0.119336 Jul 12 14:33:11.519647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 53/93] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:11 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:11.608027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.617188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d7fe940a-b4de-47ca-9256-b1d7339681ef tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.365246 Jul 12 14:33:11.618164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 41/94] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:11 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:11.701910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:11.702659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:11.709121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.709596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.710355 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:11.710785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:11.850015 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:11.857985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d99b8d74-1bac-4f81-8492-d00d20a069d4 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.159826 Jul 12 14:33:11.858586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 54/95] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:11 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:12.418133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:12.419007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:12.428176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.428631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.429489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.429900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.536579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:12.537203 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:12.548056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.548514 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.549307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.552876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.654293 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:12.670495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-11f5fcb1-abf7-4772-b5b7-255f11ef026a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1218 microversion: 2.1 time: 0.137748 Jul 12 14:33:12.679552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 55/96] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:12 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:12.684165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:12.684791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:12.691883 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.692351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.693150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.693768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.841850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:12.852300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:12.853866 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:12.864223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f457d7c7-dfd6-424d-ba5e-d421047c74ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.451853 Jul 12 14:33:12.865074 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 42/97] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:12 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:12.874612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:12.875450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:12.887370 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.891039 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.894791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:12.895712 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:12.897062 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:12.906639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-72fbd3b5-f341-40a5-8889-18bab5dba7a1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.233927 Jul 12 14:33:12.909371 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 56/98] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:12 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:13.140898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:13.148737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6844416b-8503-4984-8ce1-53bb74ff6604 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.277863 Jul 12 14:33:13.149497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 43/99] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:12 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:13.701272 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:13.703126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:13.711876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.714843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:13.715964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.716691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:13.828747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:13.837259 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c494e81e-1e75-49e6-9ceb-1547fc270170 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1272 microversion: 2.1 time: 0.152983 Jul 12 14:33:13.837949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 57/100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:13 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:13.882828 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:13.883443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:13.889567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.890058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:13.890832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.891275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:13.924352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:13.924973 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:13.931263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.932330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:13.933587 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:13.934212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:14.079806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.088179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-df5086bb-39bc-4d9b-8a6b-22dde00ecf24 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.168137 Jul 12 14:33:14.089477 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 58/101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:13 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:14.095791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.105168 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.106758 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.107984 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d0ba4673-a68d-44f6-a51b-48a832f38358 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.229107 Jul 12 14:33:14.118229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 44/102] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:13 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:14.167037 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:14.167907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:14.174183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:14.174859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:14.175789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:14.176377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:14.358359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.368982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-aca45914-f5da-4ecf-bc9a-e9a023ce8dd3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.206501 Jul 12 14:33:14.369658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 59/103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:14 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:14.854808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:14.856239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:14.863538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:14.863991 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:14.864760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:14.865419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:14.959816 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:14.968169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fe5dc08f-c337-4f76-8133-0b3058275c8b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1272 microversion: 2.1 time: 0.117281 Jul 12 14:33:14.969544 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 45/104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:14 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:15.112030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:15.113306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:15.136584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:15.138654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:15.153184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.153670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.154558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.155019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.170255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.170708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.172011 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.172452 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.176805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:15.354373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:15.364626 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-07a06bbc-6977-40cc-9067-5017d0124d27 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.261586 Jul 12 14:33:15.365227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 60/105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:15 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:15.385695 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:15.395301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:15.397065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:15.397229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:15.397983 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:15.398731 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1c05c8c0-868a-401a-af6d-af9896f465c6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.276028 Jul 12 14:33:15.399978 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 46/106] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:15 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:15.412041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.413103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.414349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.419449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.649559 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:15.664917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3abd6ee8-2c20-4623-837d-ed6d6308c86e tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.279124 Jul 12 14:33:15.666021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 61/107] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:15 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:15.985727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:15.986392 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:15.995420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.996826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:15.997843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:15.998559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.342099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-14e0dacb-72d3-424a-a591-d98f9922e64b req-21f2c500-0c42-4717-95ee-89f88f6e895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223a3cd9-6088-4e3d-a21b-1430e2afb13b", "name": "network-vif-plugged", "status": "completed", "tag": "f593632b-dfcc-4876-8e84-2597e503eacd"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:16.355444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-14e0dacb-72d3-424a-a591-d98f9922e64b req-21f2c500-0c42-4717-95ee-89f88f6e895f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.356114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-14e0dacb-72d3-424a-a591-d98f9922e64b req-21f2c500-0c42-4717-95ee-89f88f6e895f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.373437 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-14e0dacb-72d3-424a-a591-d98f9922e64b req-21f2c500-0c42-4717-95ee-89f88f6e895f service nova] Creating event network-vif-plugged:f593632b-dfcc-4876-8e84-2597e503eacd for instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b on hv-cinder-83699 Jul 12 14:33:16.382929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-14e0dacb-72d3-424a-a591-d98f9922e64b req-21f2c500-0c42-4717-95ee-89f88f6e895f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300332 Jul 12 14:33:16.384527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 62/108] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:33:16.395782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:16.396724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:16.406218 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.406934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.407925 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.408569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.633919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.644754 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-22cc819a-0a22-455f-b8c0-6a7da8ba8401 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.255967 Jul 12 14:33:16.645455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 63/109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:16 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:16.654453 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:16.662269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:16.677875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.678350 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.679149 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.679584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.684817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.699486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fb1f9a6e-9d6a-4605-bb79-8d8900ac0dd7 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.716110 Jul 12 14:33:16.700465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 47/110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:15 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:16.706422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:16.709608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:16.718720 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.719835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.720839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:16.721556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:16.857049 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.864706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3a641121-7155-4f19-9d00-030c98717137 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.162431 Jul 12 14:33:16.865284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 48/111] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:16 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:16.904032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.912511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.914083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:16.915211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7e5e6e43-2d91-4858-8593-83a50bfdbf21 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.264570 Jul 12 14:33:16.915775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 64/112] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:16 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:17.661076 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:17.661721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:17.668311 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.668777 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.669591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.670206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.719487 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:17.721775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:17.726966 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.727593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.728502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.729081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.826717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:17.835417 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-08f28075-9007-463a-876d-a468ed241c3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.178141 Jul 12 14:33:17.840051 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 49/113] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:17 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:17.883608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:17.884475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:17.891533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.891936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.892874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.893533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.930725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:17.940077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-734460e3-d6ea-4c56-ab33-699a0f5a88f5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.225029 Jul 12 14:33:17.940957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 65/114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:17 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:17.946537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:17.947142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:17.965299 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.966016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:17.966991 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:17.967512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:18.062418 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:18.071610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6d4a2cad-aa0f-4798-b8ec-d8b3d5a8c5a5 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.191760 Jul 12 14:33:18.075533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 50/115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:17 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:18.112985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:18.123920 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:18.126080 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:18.127188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1708ad38-e70d-46c0-a633-d5fcd4d710a8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.185082 Jul 12 14:33:18.127743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 66/116] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:17 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:18.400029 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-ea6f7a8d-1d03-47d4-8408-b0a2bbb71029 req-efb437c5-9a04-4561-b180-fa0d89d9d89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632d5e0-9cae-4a5d-9607-4b8f91601de6", "name": "network-vif-plugged", "status": "completed", "tag": "54c4615b-3a44-4b7d-a5d9-a95f0077ce44"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:18.410271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ea6f7a8d-1d03-47d4-8408-b0a2bbb71029 req-efb437c5-9a04-4561-b180-fa0d89d9d89f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:18.411015 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ea6f7a8d-1d03-47d4-8408-b0a2bbb71029 req-efb437c5-9a04-4561-b180-fa0d89d9d89f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:18.423515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-ea6f7a8d-1d03-47d4-8408-b0a2bbb71029 req-efb437c5-9a04-4561-b180-fa0d89d9d89f service nova] Creating event network-vif-plugged:54c4615b-3a44-4b7d-a5d9-a95f0077ce44 for instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 on hv-cinder-83699 Jul 12 14:33:18.429445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-ea6f7a8d-1d03-47d4-8408-b0a2bbb71029 req-efb437c5-9a04-4561-b180-fa0d89d9d89f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Jul 12 14:33:18.430511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 51/117] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:18.856855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:18.865416 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:18.881692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:18.882825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:18.886095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:18.888507 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:18.980094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:18.980796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:18.997934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:18.999565 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.002502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.005936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.143331 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.158699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0664d425-1773-44f9-8e1f-7467b1dc2f04 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.302670 Jul 12 14:33:19.173775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 67/118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:18 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:19.185259 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:19.186182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:19.208161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.209088 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.211336 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.213554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.295634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.307092 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2dfac5af-8a8d-4db6-ae7b-92b80ce86af3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.335589 Jul 12 14:33:19.309662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 52/119] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:18 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:19.321245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:19.322251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:19.329455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.329976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.330871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.331394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.532649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.541510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3594fe86-0f8d-4f59-9e77-525ad1501941 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.366215 Jul 12 14:33:19.551730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 68/120] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:19 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:19.557535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-a6fc8322-20fe-4060-8fb1-9b2e154ad4de req-4cdea429-c359-4d67-a55c-4fc5f79bb516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da0805-0fdd-4304-a43c-c146790e51ca", "tag": "b051b798-3350-4521-9b63-8f95b0be6a06"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:19.568712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a6fc8322-20fe-4060-8fb1-9b2e154ad4de req-4cdea429-c359-4d67-a55c-4fc5f79bb516 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:19.569882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a6fc8322-20fe-4060-8fb1-9b2e154ad4de req-4cdea429-c359-4d67-a55c-4fc5f79bb516 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:19.583524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-a6fc8322-20fe-4060-8fb1-9b2e154ad4de req-4cdea429-c359-4d67-a55c-4fc5f79bb516 service nova] Creating event network-changed:b051b798-3350-4521-9b63-8f95b0be6a06 for instance 16da0805-0fdd-4304-a43c-c146790e51ca on hv-cinder-83699 Jul 12 14:33:19.595923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.597764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-a6fc8322-20fe-4060-8fb1-9b2e154ad4de req-4cdea429-c359-4d67-a55c-4fc5f79bb516 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035997 Jul 12 14:33:19.598755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 69/121] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:19.607185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.609797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:19.611782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b4c5f2a8-0393-41f3-bc3e-18c481180bc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.298115 Jul 12 14:33:19.612643 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 53/122] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:19 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:20.176762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:20.177455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:20.184340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.184833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.185679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.186179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.324427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:20.325025 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:20.327009 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:20.329044 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:20.343313 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.344157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.345257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.346228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.346474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.348749 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:20.357350 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ff36c8c-f9f5-4889-99b4-87d213d652b0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.184906 Jul 12 14:33:20.357946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 70/123] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:20 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:20.450022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-bb6def28-c217-4cc9-8259-883a246d8b0d req-fb9333dc-1985-4f3a-b33f-ae32be63151f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "name": "network-vif-plugged", "status": "completed", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:20.454745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:20.460747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-bb6def28-c217-4cc9-8259-883a246d8b0d req-fb9333dc-1985-4f3a-b33f-ae32be63151f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.461214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-bb6def28-c217-4cc9-8259-883a246d8b0d req-fb9333dc-1985-4f3a-b33f-ae32be63151f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.474965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-bb6def28-c217-4cc9-8259-883a246d8b0d req-fb9333dc-1985-4f3a-b33f-ae32be63151f service nova] Creating event network-vif-plugged:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:33:20.480670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-bb6def28-c217-4cc9-8259-883a246d8b0d req-fb9333dc-1985-4f3a-b33f-ae32be63151f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035570 Jul 12 14:33:20.481517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 71/124] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:20.517300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.528242 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c992cfd7-8581-4bef-b8da-95a3948269c5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.207807 Jul 12 14:33:20.529481 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 54/125] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:20 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:20.561215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:20.562548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:20.569805 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.570253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.571023 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.571463 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.631935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:20.632546 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:20.646690 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.647146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.647916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:20.648558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:20.752126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.760959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7d1aab1f-9021-4ed1-b0b0-043ec3dead74 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1313 microversion: 2.1 time: 0.205058 Jul 12 14:33:20.762245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 72/126] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:20 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:20.903921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.912328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.914588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:20.915842 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c5c97ff7-cba5-47cc-8d69-008e31d62dc3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.288490 Jul 12 14:33:20.916466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 55/127] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:20 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:21.374202 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:21.375086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:21.383953 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.385397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.386308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.386944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.548823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:21.550471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:21.557298 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.557783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.558958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.559404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.578434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:21.590187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bdb1c50b-ff3a-43c6-b28d-8011c5c6b2a5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1366 microversion: 2.1 time: 0.220068 Jul 12 14:33:21.590988 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 73/128] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:21 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:21.763792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:21.772912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d0830c79-ac21-4c42-8231-a369f8419172 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.230882 Jul 12 14:33:21.773872 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 56/129] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:21 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:21.789362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:21.790242 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:21.797892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.799216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.800315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.801092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.934993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:21.935863 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:21.945992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.948571 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.949822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:21.951082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:21.996369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.020196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-24748ffc-c627-499b-920d-fee26e38d705 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1499 microversion: 2.1 time: 0.230686 Jul 12 14:33:22.021279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 74/130] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:21 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1499 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:22.179099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.194176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.198336 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.200149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9fd665f1-836e-494a-bd19-16500d0440ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.270216 Jul 12 14:33:22.212400 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 57/131] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:21 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:22.609863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:22.610932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:22.617910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.618361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.619362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.619989 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.773022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.783222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f02025af-6185-4354-a128-72854b8c6852 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1556 microversion: 2.1 time: 0.178826 Jul 12 14:33:22.803447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:22.804219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:22.809609 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 75/132] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:22 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:22.815778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:22.816278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:22.820727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.821186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.822139 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.822902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.834115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.834553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.843924 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:22.845469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:22.981083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:22.989812 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5f606a6d-61bc-4b1d-8b92-df05ba8ed22a tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.194550 Jul 12 14:33:22.990325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 58/133] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:22 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:22.993845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-10305bfd-9139-4f08-89a4-e7e16ce35693 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182890 Jul 12 14:33:22.994586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 76/134] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:33:22 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:23.220343 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:23.221253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:23.229127 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:23.229892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:23.231080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:23.231797 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:23.372684 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:23.381372 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:23.383182 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:23.384485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-91b00a4b-b255-46ea-935d-0dfedd4c3cd5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.169709 Jul 12 14:33:23.385650 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 59/135] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:23 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:24.005742 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:24.006360 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:24.012845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:24.013409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:24.014510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:24.014865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:24.239348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:24.247243 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e6c41c86-3bcb-4d45-8fe4-6ac1177517a3 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.245330 Jul 12 14:33:24.247912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 77/136] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:24 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:24.402432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:24.404263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:24.410890 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:24.411530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:24.412490 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:24.413078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:24.534776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-97e4ba38-6a14-4603-a940-e23a050f8348 req-9f6100b5-649f-46e8-8cca-337d529c192f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a632d5e0-9cae-4a5d-9607-4b8f91601de6", "tag": "54c4615b-3a44-4b7d-a5d9-a95f0077ce44"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:24.544978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-97e4ba38-6a14-4603-a940-e23a050f8348 req-9f6100b5-649f-46e8-8cca-337d529c192f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:24.546053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-97e4ba38-6a14-4603-a940-e23a050f8348 req-9f6100b5-649f-46e8-8cca-337d529c192f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:24.571789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-97e4ba38-6a14-4603-a940-e23a050f8348 req-9f6100b5-649f-46e8-8cca-337d529c192f service nova] Creating event network-changed:54c4615b-3a44-4b7d-a5d9-a95f0077ce44 for instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 on hv-cinder-83699 Jul 12 14:33:24.578685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-97e4ba38-6a14-4603-a940-e23a050f8348 req-9f6100b5-649f-46e8-8cca-337d529c192f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048250 Jul 12 14:33:24.580193 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 78/137] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:24.586185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:24.596022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:24.597868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:24.599095 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9beb2d09-bb7d-4781-b3a0-2f916d336a57 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.200495 Jul 12 14:33:24.612137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 60/138] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:24 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:33:25.264689 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:25.265616 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:25.271950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:25.272397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:25.273156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:25.273655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:25.455400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:25.463278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1ea989c1-e8d0-472f-855f-a52e17684eeb tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.202928 Jul 12 14:33:25.463861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 79/139] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:25 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:25.625795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:25.627204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:25.633767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:25.634220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:25.634993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:25.635424 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:25.784367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:25.793230 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:25.794773 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:25.800617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-082731f9-26f8-447a-8cd4-dbf29b047a71 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.177889 Jul 12 14:33:25.801578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 61/140] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:25 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:26.481657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:26.482675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:26.496359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.497031 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:26.498650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.499843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:26.687163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:26.704143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4934fb0c-cb66-4695-885f-817eacad1682 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.227295 Jul 12 14:33:26.706060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 80/141] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:26 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:26.819786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:26.821106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:26.828567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.829286 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:26.830117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.830541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:26.976670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a0b1e74-bce3-41b5-87cd-0b6001caf4af"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:26.978395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:26.995272 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.996556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:26.998293 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:26.999572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:27.036847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:27.057068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:27.058921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:27.060039 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3a01d3b1-f522-412a-8ff7-c0d3efaaba84 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.245295 Jul 12 14:33:27.060600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 62/142] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:26 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:27.721899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:27.722571 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:27.733022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:27.733901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:27.735235 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:27.736511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:27.756249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:27.902219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:27.910649 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cdc07c82-2091-4f3f-a8e0-da2522264766 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.193171 Jul 12 14:33:27.911225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 63/143] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:27 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:28.078296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:28.079344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:28.086302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:28.087226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:28.088499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:28.089319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:28.380649 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:28.395542 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:28.399218 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:28.400721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-743c6367-0797-47d5-bf40-41c7e718da4c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.327763 Jul 12 14:33:28.413990 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 64/144] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:28 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:33:28.504342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-84ea41ac-0aea-4b3e-adf4-29536c79c85b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "POST /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.533048 Jul 12 14:33:28.513560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 81/145] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:33:26 2022] POST /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b/os-volume_attachments => generated 194 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:33:28.928823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:28.929539 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:28.938359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:28.938984 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:28.940273 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:28.940792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:29.120853 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:29.131590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-60d9ad51-2169-4612-b7e8-004a34182e00 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.207381 Jul 12 14:33:29.132226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 65/146] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:28 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:29.424469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:29.425596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:29.429514 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=96 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.437504 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:29.438214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:29.439553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:29.440079 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:29.581609 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:29.593370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:29.595475 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:29.596963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b10b02bd-afbb-4106-9c4b-df1054165564 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1405 microversion: 2.20 time: 0.177779 Jul 12 14:33:29.597654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 82/147] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:29 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:30.153942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:30.154591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:30.161358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:30.161821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:30.162590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:30.163156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:30.333925 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:30.343590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7316ee3f-b56e-41db-8e54-139f87f3f3e4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.197135 Jul 12 14:33:30.344859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 66/148] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:30 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:30.422513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-0be0f7a6-a1b5-4004-8701-7f18550554b9 req-1c344dbf-ff86-49a0-8656-0ce6e5cbd53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da0805-0fdd-4304-a43c-c146790e51ca", "name": "network-vif-plugged", "status": "completed", "tag": "b051b798-3350-4521-9b63-8f95b0be6a06"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:30.433785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0be0f7a6-a1b5-4004-8701-7f18550554b9 req-1c344dbf-ff86-49a0-8656-0ce6e5cbd53b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:30.433785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-0be0f7a6-a1b5-4004-8701-7f18550554b9 req-1c344dbf-ff86-49a0-8656-0ce6e5cbd53b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:30.453042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-0be0f7a6-a1b5-4004-8701-7f18550554b9 req-1c344dbf-ff86-49a0-8656-0ce6e5cbd53b service nova] Creating event network-vif-plugged:b051b798-3350-4521-9b63-8f95b0be6a06 for instance 16da0805-0fdd-4304-a43c-c146790e51ca on hv-cinder-83699 Jul 12 14:33:30.460919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-0be0f7a6-a1b5-4004-8701-7f18550554b9 req-1c344dbf-ff86-49a0-8656-0ce6e5cbd53b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042440 Jul 12 14:33:30.462212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 83/149] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:30.617181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:30.617988 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:30.625166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:30.628711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:30.628711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:30.628711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:31.019817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:31.028590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:31.030760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:31.031958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d0051ba0-9a77-4bb8-95be-2d5c2c2d03a4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1596 microversion: 2.20 time: 0.420071 Jul 12 14:33:31.032519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 67/150] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:33:30 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1596 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:33:31.050671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:31.051256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:31.057458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:31.057897 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:31.058938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:31.059378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:31.139306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-31c77f9b-ab18-4911-8001-861b9e6b72d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092878 Jul 12 14:33:31.140075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 84/151] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 12 14:33:31 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:33:31.361454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:31.362068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:31.375258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:31.382094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:31.385540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:31.386315 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:31.646258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:31.653831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-51ce3d83-fb3d-48c1-8049-2d22bede295b tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.296934 Jul 12 14:33:31.654417 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 68/152] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:31 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:32.672464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:32.674003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:32.682908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:32.683623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:32.684555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:32.685167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:33.006579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:33.014231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9ec323ba-46a0-493b-b245-f3a1c6d5c293 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1314 microversion: 2.1 time: 0.346415 Jul 12 14:33:33.015464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 85/153] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:32 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:33.411347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-76a4199e-f71f-448d-8e90-50cdd82b04db req-dcf283f4-3d10-4bac-b2c8-37dc44f33034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:33.425202 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-76a4199e-f71f-448d-8e90-50cdd82b04db req-dcf283f4-3d10-4bac-b2c8-37dc44f33034 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:33.427272 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-76a4199e-f71f-448d-8e90-50cdd82b04db req-dcf283f4-3d10-4bac-b2c8-37dc44f33034 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:33.463945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-76a4199e-f71f-448d-8e90-50cdd82b04db req-dcf283f4-3d10-4bac-b2c8-37dc44f33034 service nova] Creating event network-changed:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:33:33.472654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-76a4199e-f71f-448d-8e90-50cdd82b04db req-dcf283f4-3d10-4bac-b2c8-37dc44f33034 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064894 Jul 12 14:33:33.477611 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 69/154] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:34.032192 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:34.033588 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:34.041287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.041990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.043097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.043690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.267984 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:34.278603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-14e4bb36-d3d4-4360-8b9f-65a4cd356e4e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1464 microversion: 2.1 time: 0.251527 Jul 12 14:33:34.279196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 86/155] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:34 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1464 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:34.351884 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:34.353027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:34.362578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.363249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.364391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.365894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.412829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:33:34.594216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6816a59f-58e8-4f96-ba5a-096cc3ae72ed tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 204 len: 0 microversion: 2.1 time: 0.248924 Jul 12 14:33:34.598705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 70/156] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:33:34 2022] DELETE /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:33:34.603561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:34.604174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:34.610864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.611313 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.612087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:34.612523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:34.820484 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:34.829561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-26b1470d-1fa3-4cfe-a428-81a141949ae8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.229707 Jul 12 14:33:34.831206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 87/157] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:34 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:35.848542 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:35.849235 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:35.856020 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:35.856665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:35.857465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:35.857898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:36.012037 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:36.019587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9edad318-29af-4ada-a8f6-ee3f94a707f1 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.175207 Jul 12 14:33:36.020159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 71/158] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:35 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:37.037030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:37.037599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:37.044019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:37.044464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:37.045222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:37.045854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:37.176587 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:37.179050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:37.187659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3f017d91-db84-4c42-8797-d6ccc96a2e39 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.154376 Jul 12 14:33:37.197867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 88/159] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:37 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:38.204589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:38.205140 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:38.207331 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:38.212721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:38.213168 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:38.214040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:38.214475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:38.343940 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:38.351277 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-052284bd-1224-4607-9ff1-a3afd8dd2c1d tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.151268 Jul 12 14:33:38.351842 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 72/160] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:38 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:39.368071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:39.368679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:39.376521 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:39.376971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:39.377762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:39.378199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:39.503746 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:39.511429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c75bf7b7-36ec-432c-a4f7-5773b668f7f4 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.147480 Jul 12 14:33:39.511991 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 89/161] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:39 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:40.530471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:40.531627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:40.538586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:40.539128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:40.540045 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:40.540710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:40.687237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:40.696097 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-92ca71e8-a015-4896-952f-6b3da905807e tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.170446 Jul 12 14:33:40.696751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 73/162] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:40 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:41.714042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:41.714578 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:41.725743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:41.726196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:41.726954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:41.727397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:41.862018 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:41.872866 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8bf272c8-fa4c-44bf-ae0f-ffc51f192e43 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.162693 Jul 12 14:33:41.874080 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 90/163] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:41 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:42.891604 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:42.893041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:42.899152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:42.899842 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:42.900673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:42.901200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:43.039812 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:43.047293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b926c826-3754-4757-9d42-616b601a0b03 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.161307 Jul 12 14:33:43.047876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 74/164] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:42 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:44.064364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:44.064915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:44.073124 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:44.073595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:44.074371 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:44.074808 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:44.209638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:44.218435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bd28d5a4-3fc4-4c3a-8cd5-f0753add9bb5 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.157783 Jul 12 14:33:44.219227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 91/165] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:44 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:45.236858 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:45.237239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:45.244201 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:45.244707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:45.245572 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:45.246004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:45.472211 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:45.481944 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f12c5859-68b0-484a-95c5-7e6c927e83aa tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1470 microversion: 2.1 time: 0.249872 Jul 12 14:33:45.483193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 75/166] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:45 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:46.483964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-31a148d2-2583-45d0-90af-021864570026 req-885134c3-5356-4fd8-af1b-d74fb8687991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da0805-0fdd-4304-a43c-c146790e51ca", "name": "network-vif-deleted", "tag": "b051b798-3350-4521-9b63-8f95b0be6a06"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:46.493269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-31a148d2-2583-45d0-90af-021864570026 req-885134c3-5356-4fd8-af1b-d74fb8687991 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:46.493956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-31a148d2-2583-45d0-90af-021864570026 req-885134c3-5356-4fd8-af1b-d74fb8687991 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:46.503663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:46.504306 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:46.508307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-31a148d2-2583-45d0-90af-021864570026 req-885134c3-5356-4fd8-af1b-d74fb8687991 service nova] Creating event network-vif-deleted:b051b798-3350-4521-9b63-8f95b0be6a06 for instance 16da0805-0fdd-4304-a43c-c146790e51ca on hv-cinder-83699 Jul 12 14:33:46.513823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:46.514771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:46.515257 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-31a148d2-2583-45d0-90af-021864570026 req-885134c3-5356-4fd8-af1b-d74fb8687991 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Jul 12 14:33:46.515561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:46.516001 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:46.516404 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 92/167] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:46.589030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:46.596669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a76a1eda-48e0-417b-8c14-088588665ef8 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1428 microversion: 2.1 time: 0.100857 Jul 12 14:33:46.598861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 76/168] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:46 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:46.840605 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:46.841193 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:46.847717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:46.848166 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:46.848941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:46.849422 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:46.878657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:33:46.979089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e6047079-4b78-4407-ab45-ac82c94c4dcd tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 204 len: 0 microversion: 2.1 time: 0.142137 Jul 12 14:33:46.980105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 93/169] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:33:46 2022] DELETE /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:33:46.993561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:46.994939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:47.004521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:47.005237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:47.006204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:47.006846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:47.159259 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:47.167644 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e2d8aacd-8e72-466c-86c9-f3ba17fa8697 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1551 microversion: 2.1 time: 0.181353 Jul 12 14:33:47.168206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 77/170] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:46 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:33:47.619294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:47.619996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:47.627613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:47.628063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:47.628839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:47.629274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:47.665908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:47.666828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:47.667814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lazy-loading 'fault' on Instance uuid 16da0805-0fdd-4304-a43c-c146790e51ca {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:33:47.717672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:47.725242 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5603d1e2-5f6a-4559-9b70-4504d6ff8d38 tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1304 microversion: 2.1 time: 0.111265 Jul 12 14:33:47.725879 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 94/171] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:47 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:48.185059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:48.185702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:48.192116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:48.192559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:48.193398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:48.193832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:48.334023 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:48.342955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5d7f738a-8beb-40c0-bcf9-9bc65c9f4a7b tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1551 microversion: 2.1 time: 0.162486 Jul 12 14:33:48.343657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 78/172] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:48 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:48.742802 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:48.743348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:48.754977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:48.755434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:48.756216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:48.756650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:48.802799 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:48.804216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:48.804957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lazy-loading 'fault' on Instance uuid 16da0805-0fdd-4304-a43c-c146790e51ca {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:33:48.870021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab229da11aac429698ad11d65aa58485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553646e8f0884b22ba3e3d5c6b173d1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:48.879236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b5eeb18f-5f10-45fc-b2ef-ec81c60652ff tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 200 len: 1304 microversion: 2.1 time: 0.140295 Jul 12 14:33:48.880800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 95/173] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:48 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:49.361754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:49.363547 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:49.370209 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:49.370780 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:49.371734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:49.372439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:49.378301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:49.547154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:49.558115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b1cdb7b2-e060-4de0-9629-65c5c1108a2a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1551 microversion: 2.1 time: 0.202057 Jul 12 14:33:49.559138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 79/174] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:49 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1551 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:49.898161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:49.898775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] [instance: 16da0805-0fdd-4304-a43c-c146790e51ca] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:49.905982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:49.906451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:49.907227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:49.907664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:49.921053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] HTTP exception thrown: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Request method failure captured: Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca HTTP/1.1 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYjI0slgAbykFaEgOfW02NFoGqUz_af5eOsnzYi7rlzywcu7Xif7xB9Q1KvDS4bgZU2p8GjUPa4kRMMRGKC14D5IUh-QFvJuqXc1xhdZp9JaHIkdsnT-AC5nju10uI53Y3Ko2eEWwzPzmD3qmvqCNksFRQ-EL9ODyNZ_VGaPFFbw80 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 553646e8f0884b22ba3e3d5c6b173d1b Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesNegativeTest-1066720223 Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:33:49.925701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/553646e8f0884b22ba3e3d5c6b173d1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/553646e8f0884b22ba3e3d5c6b173d1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/553646e8f0884b22ba3e3d5c6b173d1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_553646e8f0884b22ba3e3d5c6b173d1b", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesNegativeTest-1066720223 Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 553646e8f0884b22ba3e3d5c6b173d1b Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesNegativeTest-1066720223 Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesNegativeTest-1066720223-project Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: ab229da11aac429698ad11d65aa58485 Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesNegativeTest-1066720223-project Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. Jul 12 14:33:49.927225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '16da0805-0fdd-4304-a43c-c146790e51ca'} Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:33:49.928196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. Jul 12 14:33:49.929668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:49.930934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] Returning 404 to user: Instance 16da0805-0fdd-4304-a43c-c146790e51ca could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:33:49.930934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c8a4806c-f8c8-4429-b5c7-2802cc56e8ec tempest-VolumesNegativeTest-1066720223 tempest-VolumesNegativeTest-1066720223-project] 10.222.0.25 "GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca" status: 404 len: 111 microversion: 2.1 time: 0.032904 Jul 12 14:33:49.930934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 96/175] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:49 2022] GET /compute/v2.1/servers/16da0805-0fdd-4304-a43c-c146790e51ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:50.578727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:50.579427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:50.586109 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:50.586631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:50.587476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:50.588029 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:50.893780 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:50.904208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c0499063-6bc6-4ec7-8aa2-e6d945c5ac69 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1551 microversion: 2.1 time: 0.329572 Jul 12 14:33:50.904831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 80/176] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:50 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1551 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:51.143364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-db84c0b5-d6fa-4a00-9ff9-6ab944991397 req-7d447247-ee5d-418c-8b77-93094c8b90e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223a3cd9-6088-4e3d-a21b-1430e2afb13b", "name": "network-vif-deleted", "tag": "f593632b-dfcc-4876-8e84-2597e503eacd"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:33:51.157508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-db84c0b5-d6fa-4a00-9ff9-6ab944991397 req-7d447247-ee5d-418c-8b77-93094c8b90e8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:51.158058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-db84c0b5-d6fa-4a00-9ff9-6ab944991397 req-7d447247-ee5d-418c-8b77-93094c8b90e8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:51.174457 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-db84c0b5-d6fa-4a00-9ff9-6ab944991397 req-7d447247-ee5d-418c-8b77-93094c8b90e8 service nova] Creating event network-vif-deleted:f593632b-dfcc-4876-8e84-2597e503eacd for instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b on hv-cinder-83699 Jul 12 14:33:51.180434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-db84c0b5-d6fa-4a00-9ff9-6ab944991397 req-7d447247-ee5d-418c-8b77-93094c8b90e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041450 Jul 12 14:33:51.185010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 97/177] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:33:51.924552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:51.925167 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:51.931251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:51.931699 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:51.932466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:51.932900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:52.029392 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ac1cdd046a4ae4b9f41b75d347d997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2e10a0973e431db6cc11cc924fd826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:33:52.042944 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-09cd4512-1037-4bbd-a65d-681afc4ff3ab tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 200 len: 1344 microversion: 2.1 time: 0.122825 Jul 12 14:33:52.043516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 81/178] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:51 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 1344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:33:53.061348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:53.062051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:53.068362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:53.068749 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:53.069623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:53.070085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:53.084765 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] HTTP exception thrown: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Request method failure captured: Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b HTTP/1.1 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYCOmLMkTG5xA1gAbh2SFS3jCv-8Ljp2Rkdbh06jwrNnAxi67iNHJFwOy8fEXL3JuyZHVTLsO_8TxZUH3wAKdgqBM3SWUUhXkz2t-JfF_pz5DAQPwpJr7C0GLAlA2GeG0XaHt1q4bexMX-sd-9eWIzOmlQLX9cHujAz8IQKbFosUmA Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:33:53.086539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd2e10a0973e431db6cc11cc924fd826", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: d1ac1cdd046a4ae4b9f41b75d347d997 Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.087813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '223a3cd9-6088-4e3d-a21b-1430e2afb13b'} Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:33:53.088470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.089546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.091884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Returning 404 to user: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:33:53.091884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86138357-80df-432b-85c4-63e5931fb4c3 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 404 len: 111 microversion: 2.1 time: 0.031658 Jul 12 14:33:53.091884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 98/179] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:53 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:53.199698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:53.200681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:53.207399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:53.207894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:53.208997 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:53.209627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:53.224745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] HTTP exception thrown: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Request method failure captured: Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b/os-volume_attachments HTTP/1.1 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYYCOmLMkTG5xA1gAbh2SFS3jCv-8Ljp2Rkdbh06jwrNnAxi67iNHJFwOy8fEXL3JuyZHVTLsO_8TxZUH3wAKdgqBM3SWUUhXkz2t-JfF_pz5DAQPwpJr7C0GLAlA2GeG0XaHt1q4bexMX-sd-9eWIzOmlQLX9cHujAz8IQKbFosUmA Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:33:53.230829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd2e10a0973e431db6cc11cc924fd826", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: d1ac1cdd046a4ae4b9f41b75d347d997 Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.232031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'server_id': '223a3cd9-6088-4e3d-a21b-1430e2afb13b'} Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:33:53.232825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:53.234220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:53.235772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Returning 404 to user: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:33:53.235772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3e435346-10a4-4998-a498-da3443597b7a tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036976 Jul 12 14:33:53.235772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 82/180] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:33:53 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:54.443436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:54.444107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:54.450568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:54.451027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:54.451831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:54.452414 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:54.467771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] HTTP exception thrown: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Request method failure captured: Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b HTTP/1.1 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYCOmLMkTG5xA1gAbh2SFS3jCv-8Ljp2Rkdbh06jwrNnAxi67iNHJFwOy8fEXL3JuyZHVTLsO_8TxZUH3wAKdgqBM3SWUUhXkz2t-JfF_pz5DAQPwpJr7C0GLAlA2GeG0XaHt1q4bexMX-sd-9eWIzOmlQLX9cHujAz8IQKbFosUmA Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:33:54.469312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd2e10a0973e431db6cc11cc924fd826", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: d1ac1cdd046a4ae4b9f41b75d347d997 Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.470649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '223a3cd9-6088-4e3d-a21b-1430e2afb13b'} Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:33:54.471378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.472547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.473823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Returning 404 to user: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:33:54.473823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01f7827c-365f-4071-87a8-8eae5f3d0a79 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 404 len: 111 microversion: 2.1 time: 0.031219 Jul 12 14:33:54.474454 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 99/181] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:33:54 2022] DELETE /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:54.479394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:33:54.480515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] [instance: 223a3cd9-6088-4e3d-a21b-1430e2afb13b] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:33:54.487726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:54.488340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:54.489263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:33:54.489869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:33:54.507894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] HTTP exception thrown: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Request method failure captured: Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b HTTP/1.1 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYYCOmLMkTG5xA1gAbh2SFS3jCv-8Ljp2Rkdbh06jwrNnAxi67iNHJFwOy8fEXL3JuyZHVTLsO_8TxZUH3wAKdgqBM3SWUUhXkz2t-JfF_pz5DAQPwpJr7C0GLAlA2GeG0XaHt1q4bexMX-sd-9eWIzOmlQLX9cHujAz8IQKbFosUmA Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:33:54.511244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd2e10a0973e431db6cc11cc924fd826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd2e10a0973e431db6cc11cc924fd826", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: bd2e10a0973e431db6cc11cc924fd826 Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-DeleteServersTestJSON-686479934 Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: d1ac1cdd046a4ae4b9f41b75d347d997 Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-DeleteServersTestJSON-686479934-project Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.512696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '223a3cd9-6088-4e3d-a21b-1430e2afb13b'} Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:33:54.513562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. Jul 12 14:33:54.514867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:33:54.515979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] Returning 404 to user: Instance 223a3cd9-6088-4e3d-a21b-1430e2afb13b could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:33:54.515979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7f475d02-a48e-43bf-9fb8-117aadcf20b8 tempest-DeleteServersTestJSON-686479934 tempest-DeleteServersTestJSON-686479934-project] 10.222.0.25 "GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b" status: 404 len: 111 microversion: 2.1 time: 0.039632 Jul 12 14:33:54.516127 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 83/182] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:33:54 2022] GET /compute/v2.1/servers/223a3cd9-6088-4e3d-a21b-1430e2afb13b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:34:04.818623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.819354 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:04.950669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1332798930", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:07.652747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] validate_networks() for [('201fc1a4-0f58-499f-9b58-5a3333fb7ca5', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:34:08.417764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:34:08.417764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:34:08.417764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:34:08.417764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:34:08.417764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:34:08.440081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:08.440556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:08.441577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:08.442321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:08.476177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:08.481696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for user a48066ed22e14c64a316fe4d66394f44 and project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:08.498994 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:34:08.509270 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:34:08.588580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-497f8816-faba-4b28-a218-45407c27c81f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.773150 Jul 12 14:34:08.590399 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 100/183] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:34:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:34:08.603295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1c7b9e7b-d747-47f9-a951-83bea696b9cf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:08.622347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1c7b9e7b-d747-47f9-a951-83bea696b9cf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:08.628710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=23 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:08.633468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=20 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:08.699478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1c7b9e7b-d747-47f9-a951-83bea696b9cf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:08.708847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1c7b9e7b-d747-47f9-a951-83bea696b9cf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1222 microversion: 2.1 time: 0.109864 Jul 12 14:34:08.709772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 84/184] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:08 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:08.845204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-716109486", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:08.973877 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] validate_networks() for [('201fc1a4-0f58-499f-9b58-5a3333fb7ca5', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:34:09.505127 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:34:09.505596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:34:09.506321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:34:09.506970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:34:09.507597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:34:09.519318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:09.521534 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:09.523077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:09.523799 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:09.556089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:09.560985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for user a48066ed22e14c64a316fe4d66394f44 and project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:09.573641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:34:09.575940 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:34:09.629017 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3501858d-162e-473d-bed4-4ddf46f7af69 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.788291 Jul 12 14:34:09.630056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 101/185] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:34:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:34:09.640513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c5d6d672-61e2-496b-8e00-978949ddb586 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:09.641673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c5d6d672-61e2-496b-8e00-978949ddb586 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:09.706334 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c5d6d672-61e2-496b-8e00-978949ddb586 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:09.716892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c5d6d672-61e2-496b-8e00-978949ddb586 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1221 microversion: 2.1 time: 0.080729 Jul 12 14:34:09.728973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 85/186] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:09 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:10.741322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:10.741967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:10.763218 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:10.763717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:10.764651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:10.765170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:10.887563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:10.906997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-29b974c6-30cc-42c4-acaf-384fd711cce5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1273 microversion: 2.1 time: 0.173513 Jul 12 14:34:10.908233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 102/187] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:10 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:11.924967 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:11.926117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:11.932654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:11.933438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:11.934657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:11.935804 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:12.119605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:12.143114 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0c9533d7-498c-4275-a7c4-707ba84eef13 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1279 microversion: 2.1 time: 0.222129 Jul 12 14:34:12.143705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 86/188] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:11 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:12.534617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-ec2e166d-268d-4bb9-b3e7-65ba80836c0d req-94ff3821-12f5-4295-bc57-1c67a9ff2ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961281e0-0b38-46fe-b815-0482022c76b0", "tag": "485772cd-dc9e-4a9a-b8ec-bf7735f23b53"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:12.550682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ec2e166d-268d-4bb9-b3e7-65ba80836c0d req-94ff3821-12f5-4295-bc57-1c67a9ff2ddb service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:12.551875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ec2e166d-268d-4bb9-b3e7-65ba80836c0d req-94ff3821-12f5-4295-bc57-1c67a9ff2ddb service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:12.588558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-ec2e166d-268d-4bb9-b3e7-65ba80836c0d req-94ff3821-12f5-4295-bc57-1c67a9ff2ddb service nova] Creating event network-changed:485772cd-dc9e-4a9a-b8ec-bf7735f23b53 for instance 961281e0-0b38-46fe-b815-0482022c76b0 on hv-cinder-83699 Jul 12 14:34:12.598013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-ec2e166d-268d-4bb9-b3e7-65ba80836c0d req-94ff3821-12f5-4295-bc57-1c67a9ff2ddb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066829 Jul 12 14:34:12.600019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 103/189] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:13.166762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:13.168745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:13.205913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:13.206924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:13.207899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:13.208485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:13.528469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:13.547735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-14063be6-883c-421a-bde4-f90c875b847b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.389640 Jul 12 14:34:13.548237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 87/190] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:13 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:14.565703 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:14.567184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:14.581608 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:14.582436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:14.583269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:14.583863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:15.143367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:15.152814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f2a2e95e-4bc8-4b99-b9d0-1e71ecf69b12 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.590975 Jul 12 14:34:15.154032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 104/191] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:14 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:15.237380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-7365da06-c022-4b90-9ddc-dcb2c3319b8d req-d860e3fb-9e96-432c-a237-6562f5d2c7bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56f8c4f-6c63-450b-a04a-33fbe82ae3f4", "tag": "bd8f73f6-86cd-474b-9140-d7a87f77ccc7"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:15.252247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-7365da06-c022-4b90-9ddc-dcb2c3319b8d req-d860e3fb-9e96-432c-a237-6562f5d2c7bd service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:15.252894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-7365da06-c022-4b90-9ddc-dcb2c3319b8d req-d860e3fb-9e96-432c-a237-6562f5d2c7bd service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:15.280579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-7365da06-c022-4b90-9ddc-dcb2c3319b8d req-d860e3fb-9e96-432c-a237-6562f5d2c7bd service nova] Creating event network-changed:bd8f73f6-86cd-474b-9140-d7a87f77ccc7 for instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 on hv-cinder-83699 Jul 12 14:34:15.295900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-7365da06-c022-4b90-9ddc-dcb2c3319b8d req-d860e3fb-9e96-432c-a237-6562f5d2c7bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060130 Jul 12 14:34:15.297143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 88/192] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:16.173778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:16.174452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:16.182669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:16.183212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:16.184528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:16.185472 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:16.462030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:16.470680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-334d76e7-b5b8-4cb6-9b18-305957611585 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.304507 Jul 12 14:34:16.471954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 105/193] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:16 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:17.488042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:17.488741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:17.507327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:17.507689 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:17.508472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:17.508949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:17.801841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:17.811338 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-566a7fec-1d78-45d9-8662-df0227b2cbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.327386 Jul 12 14:34:17.811922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 89/194] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:17 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:18.830239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:18.831128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:18.837897 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:18.838462 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:18.839107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:18.839703 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:19.114968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:19.123077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-091c502f-e420-424d-ae77-0fb9ceef6d3c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.297496 Jul 12 14:34:19.124142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 106/195] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:18 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:20.142164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:20.143554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:20.157840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=4 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.162911 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:20.163705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:20.164744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:20.165437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:20.520596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:20.543462 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-23cb17a6-8468-49ca-9275-9ae9e6b68cbe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.405164 Jul 12 14:34:20.544065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 90/196] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:20 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:21.560819 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:21.561814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:21.564350 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=4 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.566689 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=12 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.579868 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:21.585143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:21.592515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:21.593784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:22.091821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:22.120082 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f261467a-713b-4aa9-8efb-d86a6ade5b3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.562025 Jul 12 14:34:22.120978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 107/197] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:21 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:22.589143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4a1b0add-0b30-4a49-993c-67842ede175e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Action: 'create', calling method: .version_select at 0x7f01cf5039d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1575939642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfcsKlAG+DlmA1dPDkwC9F2mJxk6LmUNV5P+bq0n4a8Ci9YdzZri7ZVz6LgwU3XAEtPXxV5x4GAshQI0Gkgo2bJJVs+ClkYWo9JBlX0Sf8O8Lj3JzqoodwtyiL0TV8BAw=="}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:22.618053 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-4a1b0add-0b30-4a49-993c-67842ede175e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Getting quotas for project c82ac9fcca384f0793c21f7e06b234bc. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:22.622497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-4a1b0add-0b30-4a49-993c-67842ede175e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Getting quotas for user 7d098bacbe444141b25a14d9d3d06cc1 and project c82ac9fcca384f0793c21f7e06b234bc. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:22.675836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4a1b0add-0b30-4a49-993c-67842ede175e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.402103 Jul 12 14:34:22.676993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 91/198] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:34:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:23.139634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:23.141234 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:23.157084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:23.157784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:23.158882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:23.159328 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:23.401852 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:23.415438 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-045d9ce3-fae2-40ae-9a9d-da43c24fed9e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.281336 Jul 12 14:34:23.420318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 108/199] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:23 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:24.272208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:24.273234 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:24.280159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:24.280800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:24.289314 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:24.290558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:24.339047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-19cb6010-6df6-4d32-996a-a81f0743db21 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/ips" status: 200 len: 150 microversion: 2.1 time: 0.071121 Jul 12 14:34:24.339921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 92/200] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:34:24 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:24.437095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:24.437947 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:24.452140 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:24.454123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:24.458361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:24.459079 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:24.692110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:24.720256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7a568140-9547-4fe2-8501-37b7d9b764c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.287037 Jul 12 14:34:24.732678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 109/201] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:24 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:25.214678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-94b46dea-ada4-485d-8f9e-2d68db3076da req-b5065c2b-181e-4a4f-8e9e-cbdf98a7da4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961281e0-0b38-46fe-b815-0482022c76b0", "name": "network-vif-plugged", "status": "completed", "tag": "485772cd-dc9e-4a9a-b8ec-bf7735f23b53"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:25.231790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-94b46dea-ada4-485d-8f9e-2d68db3076da req-b5065c2b-181e-4a4f-8e9e-cbdf98a7da4f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:25.243812 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-94b46dea-ada4-485d-8f9e-2d68db3076da req-b5065c2b-181e-4a4f-8e9e-cbdf98a7da4f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:25.269826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-94b46dea-ada4-485d-8f9e-2d68db3076da req-b5065c2b-181e-4a4f-8e9e-cbdf98a7da4f service nova] Creating event network-vif-plugged:485772cd-dc9e-4a9a-b8ec-bf7735f23b53 for instance 961281e0-0b38-46fe-b815-0482022c76b0 on hv-cinder-83699 Jul 12 14:34:25.281075 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-94b46dea-ada4-485d-8f9e-2d68db3076da req-b5065c2b-181e-4a4f-8e9e-cbdf98a7da4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070317 Jul 12 14:34:25.282411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 93/202] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:25.743663 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:25.744286 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:25.767425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:25.767958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:25.768821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:25.769361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:26.088830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:26.104104 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-018fa741-b81a-4fb9-8e78-967d0841dd6b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.368278 Jul 12 14:34:26.116599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7517ee81-f7fa-42a7-8787-166e5b261bfa"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:26.116829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 110/203] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:25 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:26.116930 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:26.129659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:26.145489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:26.146633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:26.147254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:27.130909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:27.132162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:27.142277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:27.143426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:27.144402 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:27.145025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:27.529854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:27.548933 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-19a552b0-73ac-40b7-b53b-66979a6f51e5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.427204 Jul 12 14:34:27.559480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 111/204] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:27 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:27.629875 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e249b05c-31f4-437b-996b-2d82b47ed525 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.519474 Jul 12 14:34:27.641270 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 94/205] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:34:26 2022] POST /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments => generated 194 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:34:28.021528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-8d243d06-9c84-4823-ba49-2899a1e2ad38 req-76a35542-075d-4c38-b3c5-5f30075873ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56f8c4f-6c63-450b-a04a-33fbe82ae3f4", "name": "network-vif-plugged", "status": "completed", "tag": "bd8f73f6-86cd-474b-9140-d7a87f77ccc7"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:28.038119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8d243d06-9c84-4823-ba49-2899a1e2ad38 req-76a35542-075d-4c38-b3c5-5f30075873ea service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:28.039440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8d243d06-9c84-4823-ba49-2899a1e2ad38 req-76a35542-075d-4c38-b3c5-5f30075873ea service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:28.063782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-8d243d06-9c84-4823-ba49-2899a1e2ad38 req-76a35542-075d-4c38-b3c5-5f30075873ea service nova] Creating event network-vif-plugged:bd8f73f6-86cd-474b-9140-d7a87f77ccc7 for instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 on hv-cinder-83699 Jul 12 14:34:28.069692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-8d243d06-9c84-4823-ba49-2899a1e2ad38 req-76a35542-075d-4c38-b3c5-5f30075873ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051775 Jul 12 14:34:28.070898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 112/206] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:28.570271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:28.570868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:28.585777 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:28.586345 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:28.587326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:28.594331 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:28.791430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:28.803591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7e205e78-32f6-4317-9582-ddbd3b0d2422 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.236621 Jul 12 14:34:28.814692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 95/207] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:28 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:29.239806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:29.240474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:29.248580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:29.249542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:29.250563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:29.251236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:29.289755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5c446621-8228-4437-aff4-aeec469a2345 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/ips" status: 200 len: 150 microversion: 2.20 time: 0.056288 Jul 12 14:34:29.293915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 113/208] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 12 14:34:29 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/ips => generated 150 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:34:29.824123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:29.824775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:29.831807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:29.832260 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:29.833223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:29.833815 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:30.025741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:30.036569 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-79474165-7972-44b6-8b6c-468f80497135 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.216185 Jul 12 14:34:30.037819 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 96/209] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:29 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:31.052948 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:31.053611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:31.061366 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:31.061845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:31.062682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:31.063116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:31.325304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:31.338302 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3e8544b3-757f-4d66-ae57-98ee6da839a3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.289261 Jul 12 14:34:31.348125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 114/210] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:31 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:32.355501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:32.356124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:32.374512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:32.376098 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:32.377491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:32.378253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:32.586425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:32.595739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-27c4dd7b-f3f8-4082-b61a-8d75a8763910 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.244645 Jul 12 14:34:32.598263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 97/211] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:32 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:33.614699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:33.615314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:33.622455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:33.623406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:33.624189 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:33.624820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:33.839581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:33.848730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-31c6a304-7bb9-48bf-adb8-786fae34b13c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1321 microversion: 2.1 time: 0.237871 Jul 12 14:34:33.849711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 115/212] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:33 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:34.446507 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:34.447929 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:34.450521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=4 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:34.471949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:34.474444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:34.476038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:34.478588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:34.530242 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lazy-loading 'flavor' on Instance uuid 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:34:34.865981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:34.866598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:34.877878 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:34.880759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:34.884027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:34.885084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:34.885580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:34.917053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=79 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.026268 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fe39f5d5-37f7-48a4-b4c1-cb59b5c8d546 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/action" status: 202 len: 0 microversion: 2.20 time: 0.586280 Jul 12 14:34:35.026907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 98/213] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 14:34:34 2022] POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:34:35.036062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:35.037758 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:35.045122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.045599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.046375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.046810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.157237 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:35.168165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-be45a80c-7d69-4328-832e-fa95daf89538 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1516 microversion: 2.1 time: 0.305882 Jul 12 14:34:35.173717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 116/214] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:34 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:35.202382 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:35.210693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:35.212187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:35.213354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5f7d337b-f964-4739-aac9-1d69f91d81a0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.181607 Jul 12 14:34:35.213918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 99/215] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:35 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:35.227637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:35.228839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:35.235616 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.236061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.236829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.237258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.261435 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lazy-loading 'flavor' on Instance uuid d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:34:35.297118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.341683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c31a5578-9d09-4de1-aceb-1d59968004a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4/action" status: 200 len: 32 microversion: 2.1 time: 0.126054 Jul 12 14:34:35.342905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 100/216] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:34:35 2022] POST /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4/action => generated 32 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:34:35.354895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:35.355588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:35.362512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.363178 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.366194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:35.366799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:35.368420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-26125304-26a4-4dc6-8e78-fd04998d9c05 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Action: 'create', calling method: .version_select at 0x7f01caabfa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1989063543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuloXshPlQG2bKzUStNQ9BM9GHeBftXnxs84CN4QE9hE8YRiIPVJ7hWR4u48CBjKOr2pUc2RHvno763a51MJxMYLi8UXXIfyaVdrUNfXn25Ri1zENpTrKcujQ1svNMiqg=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:35.383051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-26125304-26a4-4dc6-8e78-fd04998d9c05 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for project aac705367c454623a23f11bfa8d25756. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:35.388310 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-26125304-26a4-4dc6-8e78-fd04998d9c05 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for user 42165c1e1b324fedbb926ac20f0f920a and project aac705367c454623a23f11bfa8d25756. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:35.423548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-26125304-26a4-4dc6-8e78-fd04998d9c05 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.246215 Jul 12 14:34:35.424316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 117/217] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:34:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:35.523163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:35.532517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-10c617d8-4558-49b5-87f4-6b5e1ade7aac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.181930 Jul 12 14:34:35.533549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 101/218] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:35 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:36.238505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:36.239180 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:36.252420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:36.253152 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:36.254183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:36.254931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:36.443957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:36.453578 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:36.455100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:36.456305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a9f3e0ed-d52e-4d01-ae3b-8f57badce21d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.228232 Jul 12 14:34:36.456865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 118/219] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:36 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:36.570276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:36.571943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:36.580532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:36.580994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:36.582005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:36.582618 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:36.751874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:36.761934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0e0a8ffa-7aae-4498-a5f7-3784b95445ec tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.215766 Jul 12 14:34:36.764609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 102/220] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:36 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:37.475593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:37.476264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:37.483619 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:37.484069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:37.484834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:37.485271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:37.630289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:37.638978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:37.640266 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:37.641492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c225eca0-2b03-410b-94ff-bd5e74b45c16 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.169789 Jul 12 14:34:37.642046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 119/221] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:37 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:37.780727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:37.781455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:37.788293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:37.788733 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:37.789531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:37.789960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:37.931709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:37.939937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c8df1e06-66e8-480f-a4a3-a1852c848ba3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.163929 Jul 12 14:34:37.940489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 103/222] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:37 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:38.659511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:38.660706 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:38.673895 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:38.675767 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:38.676566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:38.677003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:38.845900 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:38.854652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:38.856317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:38.857680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e9884ef5-38e0-4efa-a08b-95c5b923aec0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.202060 Jul 12 14:34:38.858368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 120/223] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:38 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:38.956836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:38.958519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:38.969446 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:38.972135 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:38.972815 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:38.974026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:38.974799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:39.205177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:39.216866 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-82cb6d38-001f-47fa-8ed5-659892957644 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.263482 Jul 12 14:34:39.218011 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 104/224] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:38 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:39.876360 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:39.876975 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:39.884145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:39.884865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:39.887045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:39.887734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:40.070390 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:40.108485 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:40.115823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:40.118683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f0956f08-1dcf-45d8-b622-1b4fb3f548d5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.245797 Jul 12 14:34:40.121045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 121/225] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:39 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:40.235347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:40.236678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:40.246022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:40.248250 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:40.250154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:40.251018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:40.452003 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:40.470723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b4c067d6-702c-4c3a-a2fb-e592425ffbe5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.240006 Jul 12 14:34:40.480905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 105/226] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:40 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:40.965520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5235492f-a17f-4b34-855b-d3f0c69f01ff tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: .version_select at 0x7f01cadd5940>, body: {"keypair": {"name": "tempest-keypair-1409549376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOx7Tl3jfHoGXosZbhlObzhUgw3KjFunAbhANvp+pyNO0l1CyFmJkkeM4qufD6K+2MLy899XV+0ki4E3CpWSk2xZ/SCoRg0a10wQBgM8mDZfv72GBYYjJFjbSUJsvSNZw=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:40.985978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-5235492f-a17f-4b34-855b-d3f0c69f01ff tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:40.990552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-5235492f-a17f-4b34-855b-d3f0c69f01ff tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:41.015364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5235492f-a17f-4b34-855b-d3f0c69f01ff tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055913 Jul 12 14:34:41.016394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 122/227] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:34:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:34:41.139635 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:41.140039 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:41.149884 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:41.150333 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:41.151115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:41.151553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:41.435665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:41.445907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:41.448111 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:41.449373 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7a9ff70f-9cad-4793-8856-017f5a99b2d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.314761 Jul 12 14:34:41.461422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 106/228] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:41 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:41.490135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:41.492829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:41.500449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:41.501875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:41.511563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:41.512470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:41.729936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:41.739767 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3200d687-8be1-4705-8a17-4dca0489a75c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.255440 Jul 12 14:34:41.752318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 123/229] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:41 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:42.469924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:42.470926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:42.478918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:42.479521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:42.480345 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:42.480982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:42.617122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:42.627551 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:42.630298 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:42.631487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5afedb42-4128-460e-a788-27ffb961a427 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.167310 Jul 12 14:34:42.632050 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 107/230] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:42 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:42.757272 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:42.758022 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:42.764946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:42.765593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:42.766382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:42.766821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:42.937476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:42.945439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-552d2433-9692-40c1-a8c7-5de013c031c3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.192116 Jul 12 14:34:42.946003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 124/231] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:42 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:43.002178 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1423038788", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d70325-149a-4db6-bab3-e97d17656939"}], "security_groups": [{"name": "tempest-securitygroup--188512128"}], "key_name": "tempest-keypair-1409549376", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:43.650333 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:43.651434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:43.658051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:43.658502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:43.659276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:43.659710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:43.807447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:43.815710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:43.817212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:43.818392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a2b1907-ed3b-45ac-80fc-b1ca30af47ae tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.172651 Jul 12 14:34:43.818950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 125/232] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:43 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:43.964121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:43.964623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:43.971143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:43.971586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:43.972789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:43.972789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:44.105093 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:44.113305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-893944c0-4728-4959-b695-825ecf39d66c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.153141 Jul 12 14:34:44.113893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 126/233] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:43 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:44.836876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:44.837560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:44.844058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:44.844504 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:44.845269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:44.845728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:44.983872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:44.991749 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:44.993273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:44.994456 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-af0b1f97-9370-455a-bc4e-8fca5c80dae9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.161595 Jul 12 14:34:44.995003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 127/234] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:44 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:45.130425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:45.131078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:45.137210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:45.138187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:45.138950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:45.139378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:45.277045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:45.285061 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dd27db88-b444-4fbd-8b59-ece5dd8762c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.158790 Jul 12 14:34:45.285657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 128/235] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:45 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:46.012577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:46.013373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:46.020768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:46.021217 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:46.022045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:46.022481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:46.158659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:46.166829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:46.168449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:46.169553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-91ae904b-51b4-4eed-b369-11ff8d59ed39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.160918 Jul 12 14:34:46.170447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 129/236] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:46 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:46.303239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:46.303922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:46.310252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:46.310696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:46.311450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:46.311877 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:46.446639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:46.454201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-24ddb912-312e-4975-9fe2-a5454fe4f17e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.155356 Jul 12 14:34:46.455092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 130/237] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:46 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:47.193755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:47.194390 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:47.201730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:47.202216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:47.203008 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:47.203445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:47.336699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:47.344543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:47.346108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:47.347269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-679b8059-015f-4a4f-a4d6-6dadd809cf9a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.157673 Jul 12 14:34:47.347829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 131/238] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:47 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:47.471359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:47.471888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:47.477951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:47.478403 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:47.479209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:47.479650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:47.617305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:47.625307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6705f608-6195-45f1-9316-0121998e06c7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.158078 Jul 12 14:34:47.625894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 132/239] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:47 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:48.366356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:48.367263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:48.373958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:48.374584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:48.375450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:48.375971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:48.509760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:48.518443 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:48.520167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:48.521682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c99e17da-3dca-4aa9-a7d7-fd8f79b03e4b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.159622 Jul 12 14:34:48.522458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 133/240] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:48 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:48.642869 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:48.643426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:48.649753 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:48.650205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:48.651016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:48.651650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:48.924730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:48.928005 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:48.935672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-edadf123-56be-4107-bbfe-608514a1c9aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.296759 Jul 12 14:34:48.936245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 134/241] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:48 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:49.303053 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] validate_networks() for [('81d70325-149a-4db6-bab3-e97d17656939', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:34:49.542520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:49.543874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:49.550496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.550940 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:49.551819 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.552172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:49.735604 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:49.741271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:34:49.742586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:34:49.743005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:34:49.743424 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:34:49.743841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:34:49.744717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:49.746323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:49.747879 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d43ec056-33d0-4566-b60f-cce4e0032761 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.209200 Jul 12 14:34:49.748656 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 135/242] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:49 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:49.753577 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.754246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:49.755172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.755665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:49.772735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:34:49.776661 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:34:49.788248 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:34:49.790534 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:34:49.838556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-54340cf7-2b3c-46db-a481-83a1fc829c67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.840621 Jul 12 14:34:49.839434 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 108/243] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:34:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 6843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:34:49.851421 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-48e77e62-a00f-42b5-9aff-7b67fe568634 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:49.852041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-48e77e62-a00f-42b5-9aff-7b67fe568634 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:49.904856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-48e77e62-a00f-42b5-9aff-7b67fe568634 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:49.911682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-48e77e62-a00f-42b5-9aff-7b67fe568634 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1242 microversion: 2.1 time: 0.064061 Jul 12 14:34:49.912252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 136/244] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:49 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:49.956476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:49.957293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:49.963782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.964301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:49.965414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:49.966448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:50.117974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:50.126758 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2764a5bf-8ee5-4e5e-8f8a-1fd160ed67a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.174134 Jul 12 14:34:50.127634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 109/245] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:49 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:50.767373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:50.768212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:50.777111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:50.777508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:50.778300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:50.778739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:50.918063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:50.927049 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:50.928075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:50.929314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01e6adfd-785e-47b3-b28f-63c4eab5fc60 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.167136 Jul 12 14:34:50.929934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 137/246] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:50 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:50.930351 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:50.931273 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:50.942386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:50.942864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:50.943648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:50.944082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:51.008586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:51.017090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-24e9f04f-977e-4ff5-82c9-6babf9b185d9 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1294 microversion: 2.1 time: 0.092283 Jul 12 14:34:51.017716 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 110/247] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:50 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:51.145544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:51.146169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:51.157460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:51.157915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:51.158696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:51.159129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:51.375618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:51.383290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-75472d00-f78d-4486-92e8-d8dfada048ea tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.242722 Jul 12 14:34:51.383861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 138/248] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:51 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:51.948407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:51.949036 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:51.956038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:51.956510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:51.957655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:51.958103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.039275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:52.041195 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:52.052777 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:52.053538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.054604 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:52.055050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.192729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:52.203539 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:52.205364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:52.206778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1386f196-10c4-4f60-8aaa-2516fe01c122 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1741 microversion: 2.20 time: 0.262469 Jul 12 14:34:52.207364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 111/249] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:51 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:52.360079 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:52.374920 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e033af68-7103-447a-bbc9-381e2120ed2d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.342963 Jul 12 14:34:52.384907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 139/250] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:52 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:52.399826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:52.400444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:52.407970 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:52.408671 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.411939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:52.412404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.558281 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:52.572410 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3526f8b8-4acd-406e-8fbf-a931bbecf236 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.176291 Jul 12 14:34:52.573090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 112/251] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:52 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:52.917319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-8271e800-ad8b-4232-8e78-202396f127bb req-8f4d380c-f8de-423b-924a-2d5f46e6d167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5009617-7468-48d8-81b6-718b0dbd1161", "tag": "8067ccbb-0289-4d76-be75-8d3f2b7d1fa5"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:52.933555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8271e800-ad8b-4232-8e78-202396f127bb req-8f4d380c-f8de-423b-924a-2d5f46e6d167 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:52.935309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-8271e800-ad8b-4232-8e78-202396f127bb req-8f4d380c-f8de-423b-924a-2d5f46e6d167 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:52.961524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-8271e800-ad8b-4232-8e78-202396f127bb req-8f4d380c-f8de-423b-924a-2d5f46e6d167 service nova] Creating event network-changed:8067ccbb-0289-4d76-be75-8d3f2b7d1fa5 for instance e5009617-7468-48d8-81b6-718b0dbd1161 on hv-cinder-83699 Jul 12 14:34:52.968353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-8271e800-ad8b-4232-8e78-202396f127bb req-8f4d380c-f8de-423b-924a-2d5f46e6d167 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 Jul 12 14:34:52.968968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 140/252] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:34:53.235047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:53.236357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:53.242993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.243446 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.244223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.244663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.382091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:53.391502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:53.393548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:53.394018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:53.394249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:53.395015 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-40bfe34b-d3a3-4fa0-af9a-51c3707dbd1c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1741 microversion: 2.20 time: 0.164984 Jul 12 14:34:53.395760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 113/253] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:53 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:53.400878 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.401401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.402151 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.402593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.591307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:53.592141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:53.594608 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:53.598474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.599646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.600920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.601586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.602105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7a7553b8-239e-42ad-80b5-edf0104ae9ed tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.213207 Jul 12 14:34:53.612215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 141/254] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:53 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:53.754114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-2c169be8-25c4-446f-84ca-3d5683bec583 req-350aac02-66dc-4cf0-ba27-b7e00102f6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "name": "network-vif-plugged", "status": "completed", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:53.763002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:53.769550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2c169be8-25c4-446f-84ca-3d5683bec583 req-350aac02-66dc-4cf0-ba27-b7e00102f6d8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:53.770332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2c169be8-25c4-446f-84ca-3d5683bec583 req-350aac02-66dc-4cf0-ba27-b7e00102f6d8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:53.784031 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-2c169be8-25c4-446f-84ca-3d5683bec583 req-350aac02-66dc-4cf0-ba27-b7e00102f6d8 service nova] Creating event network-vif-plugged:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:34:53.789551 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-2c169be8-25c4-446f-84ca-3d5683bec583 req-350aac02-66dc-4cf0-ba27-b7e00102f6d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039649 Jul 12 14:34:53.790796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 142/255] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:34:53.793304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-367dc262-807d-49b4-aea5-783669444d0f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.206686 Jul 12 14:34:53.794251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 114/256] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:53 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:54.414395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:54.415240 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:54.423285 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.423935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.424880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.425419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.559880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:54.568421 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:54.570090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:54.571592 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a0e12391-eab0-4232-b869-1bd4e870cec3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1741 microversion: 2.20 time: 0.162164 Jul 12 14:34:54.572366 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 143/257] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:54 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:54.619173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:54.619786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:54.627105 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.627554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.628329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.628795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.764821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:54.773152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4729de82-20f3-4a6a-9ab6-179ae5c50262 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.157761 Jul 12 14:34:54.773795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 115/258] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:54 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:54.810075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:54.810695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:54.817149 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.817666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.818483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:54.818897 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:54.958538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:54.965995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ee8099a1-7c39-435c-b070-98a9bf369856 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.160026 Jul 12 14:34:54.966642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 144/259] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:54 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:55.591636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:55.592491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:55.599014 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.599457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:55.600221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.600649 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:55.736693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:55.744774 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:55.746317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:55.748052 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8a5fa0bc-512f-4835-a7ae-a3156ee0ac34 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.160690 Jul 12 14:34:55.748608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 116/260] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:55 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:55.790634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:55.791348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:55.798204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.798731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:55.799573 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.800081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:55.930828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:55.939009 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2cc094ec-e598-45c7-86c5-ac5927f27bca tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.152284 Jul 12 14:34:55.939597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 145/261] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:55 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:55.983937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:55.984560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:55.990853 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.991305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:55.992082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:55.992522 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:56.004790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:56.132910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:56.141000 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-153fa028-faa9-4118-b42f-257000dd1e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.162006 Jul 12 14:34:56.141589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 117/262] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:55 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:56.766667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:56.767270 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:56.774269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:56.774718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:56.775499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:56.775910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:56.907433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:56.915330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:56.916834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:56.918041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-657d8439-f6b1-4964-b1c9-0180ae4f915d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.155693 Jul 12 14:34:56.918631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 146/263] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:56 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:56.956539 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:56.957185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:56.963462 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:56.963918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:56.964685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:56.965123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:57.108766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:57.116308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-196f2485-cb78-47aa-8202-13ef4beecb6e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.163643 Jul 12 14:34:57.116871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 118/264] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:56 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:57.158933 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:57.159618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:57.168976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:57.169644 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:57.170681 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:57.171123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:57.318117 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:57.326691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-901a8569-7b7a-48cf-828d-1f34c5200fc5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.172497 Jul 12 14:34:57.327275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 147/265] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:57 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:57.938225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:57.939175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:57.945541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:57.946190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:57.947163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:57.947808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:58.107749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:58.118279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:58.120302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:58.123890 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1586b738-d0c9-40ed-a888-89c9c1fa9d7c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.190478 Jul 12 14:34:58.124898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 119/266] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:57 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:34:58.141025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:58.142008 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:58.152257 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:58.152845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:58.153552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:58.153987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:58.306933 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:58.320363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ab0c1569-9756-4b79-b341-3da55729e31d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.183679 Jul 12 14:34:58.330039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 148/267] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:58 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:58.344933 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:58.346341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:58.354168 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:58.354768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:58.358357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:58.358945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:58.541130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:58.549607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b9112e94-53d9-4306-b079-4141f0c15d27 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.209808 Jul 12 14:34:58.550473 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 120/268] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:58 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:59.144615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:59.146074 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:59.153831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.154586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.155586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.156230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.320014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:59.329008 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:59.330627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:59.333571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-119dfabf-eb07-45cd-a4ef-9c8df56543d6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.193509 Jul 12 14:34:59.334528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 149/269] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:34:59 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:34:59.337753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:59.338371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:59.345232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.345720 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.346492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.346928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.566252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:34:59.566886 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:34:59.572920 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.573479 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.574525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.575167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.641083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:59.648848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b5a02e1c-fa98-445e-8bfd-99d641f40408 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.314965 Jul 12 14:34:59.650026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 121/270] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:59 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:34:59.718691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:34:59.733872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-79e0072c-327e-430f-b374-9517d68408da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.171272 Jul 12 14:34:59.734899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 150/271] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:34:59 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:34:59.777616 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-2fd10f06-1d4f-4b91-a6f2-298566e39455 req-2f9bba26-a22f-4c78-a762-677ac906a613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5009617-7468-48d8-81b6-718b0dbd1161", "name": "network-vif-plugged", "status": "completed", "tag": "8067ccbb-0289-4d76-be75-8d3f2b7d1fa5"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:34:59.787265 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:59.790189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:59.802045 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2fd10f06-1d4f-4b91-a6f2-298566e39455 req-2f9bba26-a22f-4c78-a762-677ac906a613 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:34:59.802825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2fd10f06-1d4f-4b91-a6f2-298566e39455 req-2f9bba26-a22f-4c78-a762-677ac906a613 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:34:59.819428 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-2fd10f06-1d4f-4b91-a6f2-298566e39455 req-2f9bba26-a22f-4c78-a762-677ac906a613 service nova] Creating event network-vif-plugged:8067ccbb-0289-4d76-be75-8d3f2b7d1fa5 for instance e5009617-7468-48d8-81b6-718b0dbd1161 on hv-cinder-83699 Jul 12 14:34:59.827212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-2fd10f06-1d4f-4b91-a6f2-298566e39455 req-2f9bba26-a22f-4c78-a762-677ac906a613 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053486 Jul 12 14:34:59.830890 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 122/272] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:00.353709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:00.354308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:00.356383 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=10 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:00.366153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.366603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.367382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.367949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.538310 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:00.547187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:00.548794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:00.550223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a640f7dc-cf7b-441d-a22c-81b7d6395a8f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.201089 Jul 12 14:35:00.550764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 151/273] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:00 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:00.667638 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:00.669063 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:00.676530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.677367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.678498 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.679141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.750820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:00.751621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:00.757803 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.758546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.759549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:00.760235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:00.853641 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:00.870968 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-72c0354e-7ceb-4a59-b91c-ce9a05f8874f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1367 microversion: 2.1 time: 0.208452 Jul 12 14:35:00.873463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 123/274] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:00 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:00.933827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:00.943614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-93d7744c-621e-452f-9e08-bcf5a95ed304 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.196468 Jul 12 14:35:00.944450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 152/275] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:00 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:01.315811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1851065188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1575939642", "security_groups": [{"name": "tempest-secgroup-smoke-776823701"}], "networks": [{"uuid": "0b68507e-5c8d-4b3c-9119-59ddefe556f4"}], "block_device_mapping_v2": [{"uuid": "c5800c5c-cf32-4fe4-871d-83b251ad98aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:01.478526 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] validate_networks() for [('0b68507e-5c8d-4b3c-9119-59ddefe556f4', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:35:01.569864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:01.570506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:01.588509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:01.589265 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:01.593294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:01.594026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:01.783770 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:01.786731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:01.796128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:01.797775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:01.798946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-247cfc95-91a5-4b19-8976-59b89e75d2f1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.233745 Jul 12 14:35:01.800228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 153/276] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:01 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:01.893415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:01.894038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:01.906195 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:01.906646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:01.907438 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:01.907869 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.048412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:35:02.048935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:35:02.049294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:35:02.049729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:35:02.050146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:35:02.063744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.065159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.067263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.069986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.108880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Getting quotas for project c82ac9fcca384f0793c21f7e06b234bc. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:35:02.114980 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Getting quotas for user 7d098bacbe444141b25a14d9d3d06cc1 and project c82ac9fcca384f0793c21f7e06b234bc. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:35:02.124046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:02.136957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-22c82b51-4d4d-4476-b9ff-abf34e0a1409 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1557 microversion: 2.1 time: 0.247380 Jul 12 14:35:02.137698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 154/277] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:01 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1557 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:02.142269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:02.142872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:02.144697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:02.155328 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.155776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.156830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.157282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.193219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:35:02.195653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5800c5c-cf32-4fe4-871d-83b251ad98aa',volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:35:02.348020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:02.357249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0f871c6b-a212-4449-8250-5d98bd7e62d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.218468 Jul 12 14:35:02.368491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 155/278] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:02 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:02.374902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:02.375422 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:02.382406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.382850 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.383632 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.384186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.427508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-726f8499-3320-4538-9173-f6db0e7f2273 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.115888 Jul 12 14:35:02.431141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 124/279] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:35:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:35:02.445380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1e5ddb62-6718-4c31-9c36-81ae12aca5cd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:02.446275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1e5ddb62-6718-4c31-9c36-81ae12aca5cd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:02.519046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b0f94749-8bc8-45ac-b62f-9595858e42a8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149354 Jul 12 14:35:02.520186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 156/280] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:35:02 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:02.545138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1e5ddb62-6718-4c31-9c36-81ae12aca5cd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:02.553249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1e5ddb62-6718-4c31-9c36-81ae12aca5cd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1089 microversion: 2.1 time: 0.116072 Jul 12 14:35:02.554455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 125/281] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:02 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1089 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:02.818106 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:02.818717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:02.833676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.834453 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:02.835436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:02.836110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:03.376693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:03.378092 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:03.386033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:03.387014 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:03.388431 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:03.388874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:03.467286 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:03.483027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:03.486411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:03.492017 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4cb292d4-617c-4345-96ce-159bc1dc929f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.677801 Jul 12 14:35:03.492793 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 157/282] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:02 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:03.572690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:03.573307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:03.582536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:03.583426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:03.585058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:03.585058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:03.626420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:03.652508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9bc58706-66da-4e89-b3c7-a015f148b4d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.280860 Jul 12 14:35:03.653870 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 126/283] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:03 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:03.710191 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:03.720196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-02a235a4-d0ca-418f-b853-5fbbb5b3eba6 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1187 microversion: 2.1 time: 0.151398 Jul 12 14:35:03.729944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 158/284] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:03 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:04.552033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:04.553399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:04.566545 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:04.569305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:04.571332 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:04.572924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:04.620432 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-ee4fac0c-a3c9-4546-8af9-01571a88319b req-1327efc7-d85d-4b0d-a03c-19aa0eac5095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5009617-7468-48d8-81b6-718b0dbd1161", "tag": "8067ccbb-0289-4d76-be75-8d3f2b7d1fa5"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:04.669736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ee4fac0c-a3c9-4546-8af9-01571a88319b req-1327efc7-d85d-4b0d-a03c-19aa0eac5095 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:04.671945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ee4fac0c-a3c9-4546-8af9-01571a88319b req-1327efc7-d85d-4b0d-a03c-19aa0eac5095 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:04.700437 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-ee4fac0c-a3c9-4546-8af9-01571a88319b req-1327efc7-d85d-4b0d-a03c-19aa0eac5095 service nova] Creating event network-changed:8067ccbb-0289-4d76-be75-8d3f2b7d1fa5 for instance e5009617-7468-48d8-81b6-718b0dbd1161 on hv-cinder-83699 Jul 12 14:35:04.720106 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-ee4fac0c-a3c9-4546-8af9-01571a88319b req-1327efc7-d85d-4b0d-a03c-19aa0eac5095 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097067 Jul 12 14:35:04.720934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 159/285] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:35:04.730564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:04.732214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:04.751094 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:04.751831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:04.752783 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:04.753490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:04.971350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:04.988488 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:04.992566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:04.998869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:05.008214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-342e8566-6d9a-4328-ac5b-fb04b5f4ac0a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.285895 Jul 12 14:35:05.009196 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ee640818-f4e7-4999-b639-7ae08997a777 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.499871 Jul 12 14:35:05.009370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 160/286] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:04 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:05.021740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 127/287] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:04 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:05.021979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:05.021979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:05.036834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:05.037471 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:05.038376 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:05.038823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:05.176204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:05.187732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c07fbdc1-ffbf-49b0-9fc1-8b168f0b19fb tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1205 microversion: 2.1 time: 0.177361 Jul 12 14:35:05.195253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 161/288] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:05 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1205 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:06.025263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:06.027090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:06.031319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:06.032413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:06.044959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.048773 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.049554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.050527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.052702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.058375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.068244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.068851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.287644 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:06.296735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7b8fc90f-766b-43ee-a866-74cce4e368b7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.275321 Jul 12 14:35:06.309888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:06.316899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 128/289] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:06 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:06.321756 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:06.323093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:06.323215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:06.324128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:06.324318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b6f3f64e-9445-47b3-80b3-ede42b7f1b0f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.299030 Jul 12 14:35:06.331046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 162/290] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:06 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:06.343089 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.343850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.344842 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.345721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.582092 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:06.594217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7f5a880c-2fd8-405d-94bc-3495ae7f7b2a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.275848 Jul 12 14:35:06.598783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 129/291] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:06 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:06.751699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-4dc710ca-fccc-432f-ab48-9dc79e3abbe5 req-d99477eb-5f98-4165-bc06-b943aeb603aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:06.768217 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4dc710ca-fccc-432f-ab48-9dc79e3abbe5 req-d99477eb-5f98-4165-bc06-b943aeb603aa service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:06.769857 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4dc710ca-fccc-432f-ab48-9dc79e3abbe5 req-d99477eb-5f98-4165-bc06-b943aeb603aa service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:06.803236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-4dc710ca-fccc-432f-ab48-9dc79e3abbe5 req-d99477eb-5f98-4165-bc06-b943aeb603aa service nova] Creating event network-changed:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:35:06.812414 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-4dc710ca-fccc-432f-ab48-9dc79e3abbe5 req-d99477eb-5f98-4165-bc06-b943aeb603aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065835 Jul 12 14:35:06.818763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 163/292] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:07.315494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:07.316140 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:07.322585 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.323071 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.323855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.324295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.350235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:07.351572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:07.359400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.359837 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.360602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.361032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.482742 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:07.490708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0ed8ff15-9cdb-4f42-9686-cc9221db3398 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.179579 Jul 12 14:35:07.491270 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 130/293] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:07 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:07.506163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:07.514050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:07.515657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:07.516950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fed49645-1131-4eb4-bdab-929bb325cad5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.171621 Jul 12 14:35:07.517530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 164/294] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:07 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:07.615479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:07.616090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:07.622137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.622586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.623375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:07.623809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:07.765790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:07.773501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f754c252-c146-4050-8399-7a61af92b1b8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.161871 Jul 12 14:35:07.774056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 131/295] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:07 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:08.508464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:08.509084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:08.516098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.516882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.517977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.518503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.542452 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:08.544504 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:08.568223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.569053 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.570110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.571560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.756569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:08.766924 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4a03b85d-73ff-40be-ad2d-8f47ad776b2d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.261482 Jul 12 14:35:08.777267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 165/296] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:08 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:08.777702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:08.790426 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:08.792101 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:08.792523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:08.792716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:08.794174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bbb0b2bc-ecfd-458f-ae3e-9167bf4ed85e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.262304 Jul 12 14:35:08.795191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 132/297] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:08 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:08.806751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.807520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.808649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:08.809874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:08.972259 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:08.980233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-13ae0346-1d78-4f8a-a2f4-58214e854c5d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.193092 Jul 12 14:35:08.981691 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 166/298] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:08 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:09.424538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-81423615", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1989063543", "security_groups": [{"name": "tempest-secgroup-smoke-943141086"}], "block_device_mapping_v2": [{"uuid": "da8d1431-01a6-47cb-b91e-44e26ef5238d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6738aee6-ace2-4e59-b649-77430daecb40"}]}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:09.434836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:09.536589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] validate_networks() for [('6738aee6-ace2-4e59-b649-77430daecb40', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:35:09.784882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:09.785615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:09.792215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.792667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.793583 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.794024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.920329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:35:09.920833 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:35:09.921222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:35:09.921660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:35:09.922080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:35:09.928269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:09.934814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.935308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.936122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.936617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.937395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1eb22082-8336-43bb-81b6-9ec66e037257 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.156696 Jul 12 14:35:09.937981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 167/299] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:09 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:09.943131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:09.943906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:09.950427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.950878 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.951680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:09.952125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:09.953576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:35:09.957702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for user 42165c1e1b324fedbb926ac20f0f920a and project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:35:10.016245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:35:10.018300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da8d1431-01a6-47cb-b91e-44e26ef5238d',volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:35:10.133019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:10.142632 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:10.144703 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:10.146093 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-457caa4b-c127-4a2d-9f75-7fb92e430bcc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.206793 Jul 12 14:35:10.146601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 168/300] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:09 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:10.151940 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:10.152571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:10.160931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:10.162757 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:10.166432 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:10.167076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:10.199332 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8d197536-b5b8-48ff-be60-7a9ac31e7852 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778542 Jul 12 14:35:10.201905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 133/301] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:35:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:35:10.213178 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-815a12fb-4852-449b-93e7-57621715a5be tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:10.218066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-815a12fb-4852-449b-93e7-57621715a5be tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:10.320883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-815a12fb-4852-449b-93e7-57621715a5be tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:10.329606 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-815a12fb-4852-449b-93e7-57621715a5be tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1093 microversion: 2.1 time: 0.120732 Jul 12 14:35:10.335617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 134/302] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:10 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1093 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:10.391347 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:10.399934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f64612a7-54a4-4ee3-965d-62b249012661 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.251330 Jul 12 14:35:10.400681 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 169/303] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:10 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:10.955012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:10.956305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:10.963893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:10.964707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:10.966394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:10.967293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.114080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.126226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5262fe33-ec34-41b2-9188-8601be2a8592 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.175148 Jul 12 14:35:11.126924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 135/304] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:10 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:11.169002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:11.169791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:11.176896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.177456 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.178394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.178898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.351717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:11.352625 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:11.360202 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.361031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.362474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.363128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.372244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.386086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.388780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.390715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4e79397a-0715-4450-9082-c64ddcd16cd1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.226782 Jul 12 14:35:11.419513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 170/305] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:11 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:11.421846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:11.423123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:11.449409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.450196 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.455510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:11.456035 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:11.461110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.469254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-09534933-4ae9-438f-8051-2dc9228101aa tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1199 microversion: 2.1 time: 0.121425 Jul 12 14:35:11.480212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 136/306] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:11 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:11.744075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:11.756143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-de1fe6de-6863-4672-b312-71944dfa0953 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.340235 Jul 12 14:35:11.774467 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 171/307] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:11 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:12.161542 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:12.162869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:12.170807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.171557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.173096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.173891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.322965 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:12.327107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:12.332716 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-96659aec-f08a-4d4f-a39d-5019639e93c9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.175789 Jul 12 14:35:12.342519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 137/308] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:12 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:12.409365 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:12.410131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:12.419665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.420368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.421254 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.421724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.426296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:12.488086 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:12.488866 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:12.496342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.496857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.497800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.498361 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.628866 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:12.637549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:12.639202 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:12.640884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-90cccd2e-c182-46c4-ad44-8a8f69eabb87 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.235325 Jul 12 14:35:12.652163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 172/309] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:12 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:12.655783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:12.664270 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a998ae05-927a-4c24-8e96-7e0502a9daa2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1276 microversion: 2.1 time: 0.179947 Jul 12 14:35:12.665146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 138/310] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:12 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:12.800128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:12.800745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:12.806894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.807342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:12.808119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:12.808764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.017887 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.025355 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-92d103f1-402d-422d-a351-327770f2cee9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.228982 Jul 12 14:35:13.025934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 173/311] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:12 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:13.303690 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-20cb19ab-65fc-4a7f-add9-4e756737625f req-5045f331-0f65-485f-8476-14d16ac9436e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82caa470-858f-4885-aff4-ee0bbea62417", "tag": "85b044af-a540-4ed9-bcac-01e0d29b4bb4"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:13.317829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-20cb19ab-65fc-4a7f-add9-4e756737625f req-5045f331-0f65-485f-8476-14d16ac9436e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.318274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-20cb19ab-65fc-4a7f-add9-4e756737625f req-5045f331-0f65-485f-8476-14d16ac9436e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.341400 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-20cb19ab-65fc-4a7f-add9-4e756737625f req-5045f331-0f65-485f-8476-14d16ac9436e service nova] Creating event network-changed:85b044af-a540-4ed9-bcac-01e0d29b4bb4 for instance 82caa470-858f-4885-aff4-ee0bbea62417 on hv-cinder-83699 Jul 12 14:35:13.348310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-20cb19ab-65fc-4a7f-add9-4e756737625f req-5045f331-0f65-485f-8476-14d16ac9436e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048176 Jul 12 14:35:13.349585 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:13.349734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 139/312] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:13.350483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:13.358112 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.358595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.359401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.359836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.500813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.508231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-50afaa50-f78e-4c10-a862-fa93491bacdf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.162665 Jul 12 14:35:13.508788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 174/313] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:13 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:13.659769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:13.660501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:13.666837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.667287 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.668543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.668989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.681563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:13.682268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:13.689186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.689776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.690558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:13.690997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:13.808482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.817668 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.819181 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.820349 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-81cb4f39-0690-4ed3-998c-81410a83b51e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.164892 Jul 12 14:35:13.821104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 140/314] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:13 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:13.827115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:13.835057 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f399c36d-b1b5-4ba9-81d6-2da4e9367fd2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1276 microversion: 2.1 time: 0.157341 Jul 12 14:35:13.835619 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 175/315] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:13 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:14.043091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:14.043729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:14.049972 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.050419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.051169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.051606 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.179640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:14.188718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-32053b8c-771c-4eed-99fc-530d826ff221 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.150536 Jul 12 14:35:14.189283 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 141/316] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:14 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:14.525712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:14.526322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:14.533464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.533917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.534684 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.535116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.667687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:14.675121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fb7ea4ef-7fd0-43e4-ae4f-72037720e847 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.153218 Jul 12 14:35:14.675623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 176/317] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:14 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:14.838726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:14.839347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:14.846425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.846877 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.847642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.848077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.853200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:14.853200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:14.859006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.859458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.860226 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:14.860666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:14.995077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:14.995959 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:15.003599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74c1f2ad-7a89-4e8d-baf0-61f1f218574b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1276 microversion: 2.1 time: 0.155638 Jul 12 14:35:15.004275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 177/318] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:14 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:15.004862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:15.006408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:15.007573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-529f7726-91b0-427e-8fea-06caa305ea91 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1736 microversion: 2.20 time: 0.172890 Jul 12 14:35:15.008119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 142/319] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:14 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:15.206006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:15.206542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:15.212583 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:15.213035 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:15.213836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:15.214278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:15.346455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:15.353985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c86a26e9-3c97-4db3-b341-086f031ddff9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.151911 Jul 12 14:35:15.354540 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 178/320] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:15 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:15.691760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:15.692402 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:15.698466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:15.698916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:15.699681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:15.700116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:15.829752 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:15.837557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-dda3fa5c-715d-46ef-907e-65d9eb418001 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.149611 Jul 12 14:35:15.838115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 143/321] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:15 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:16.020400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:16.021056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:16.025367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:16.025985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:16.028169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.028626 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.029436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.029876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.035953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.036408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.037177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.037673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.163963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:16.171546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ced32ae-5fcc-4aff-b289-e85f9fb24144 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1276 microversion: 2.1 time: 0.155043 Jul 12 14:35:16.172209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 179/322] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:16 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:16.175214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:16.183122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:16.185481 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:16.186645 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ac5bfd55-76d8-45b6-b6f9-e40a4714ae35 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.165235 Jul 12 14:35:16.187199 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 144/323] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:16 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:16.370595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:16.371704 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:16.377832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.378318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.379084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.379524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.509762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:16.518265 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-de8457ea-cfe4-48c1-8f44-f6b31546b381 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.151598 Jul 12 14:35:16.518841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 180/324] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:16 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:16.854606 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:16.855223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:16.862012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.862466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:16.863231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:16.863683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.016731 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.024271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0221efe7-a423-4a86-942e-1d69e0196c6c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.173644 Jul 12 14:35:17.036328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 145/325] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:16 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:17.189180 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:17.189889 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:17.196682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.197051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.197860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.198291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.208811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:17.209908 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:17.219483 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.220332 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.221532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.222449 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.414837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.424220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.425762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.426926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-28802d5d-3385-4903-b6c3-5cb7c41fe976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.224195 Jul 12 14:35:17.427850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 146/326] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:17 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:17.459346 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.467146 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-41472034-20d0-4fdd-a5f0-20741518c3b4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1276 microversion: 2.1 time: 0.281822 Jul 12 14:35:17.467712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 181/327] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:17 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:17.536302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:17.537114 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:17.543871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.544314 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.545070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:17.545527 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:17.741523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:17.752042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6882c5a4-a890-47be-847e-81cb03d8d66a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.219807 Jul 12 14:35:17.753502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 147/328] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:17 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:18.042734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:18.043392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:18.049971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.050418 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.051176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.051612 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.186108 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.194522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a3dee062-74fc-48a3-b840-79237591eebe tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.155645 Jul 12 14:35:18.195425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 182/329] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:18 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:18.447491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:18.448191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:18.455873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.456329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.457107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.457570 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.485100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:18.485848 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:18.491967 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.492516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.493396 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.493965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.592444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.600445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.601993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.603155 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c7e19398-9464-4900-b2e8-bb6e2447caac tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.160142 Jul 12 14:35:18.603709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 148/330] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:18 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:18.628800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.636859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-722465ac-7006-4a1d-aa0f-8dde46af5bc7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.156790 Jul 12 14:35:18.638051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 183/331] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:18 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:18.769563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:18.770175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:18.776216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.776689 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.777971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:18.778411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:18.914750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:18.922783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-db945356-3c3e-4599-b6b8-1d7090573374 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.157101 Jul 12 14:35:18.923376 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 149/332] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:18 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:19.211944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:19.212560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:19.219411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.219861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.220672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.221107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.380651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:19.388241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-31213b81-dbb7-4d7d-885a-2886c6f6dc3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.180328 Jul 12 14:35:19.388918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 184/333] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:19 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:19.456488 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-231489d2-9272-4749-91e7-82570de16dcb req-7b5278c4-9228-4ddb-8f24-a3f6b06c8501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "name": "network-vif-unplugged", "status": "completed", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:19.471145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-231489d2-9272-4749-91e7-82570de16dcb req-7b5278c4-9228-4ddb-8f24-a3f6b06c8501 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.471610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-231489d2-9272-4749-91e7-82570de16dcb req-7b5278c4-9228-4ddb-8f24-a3f6b06c8501 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.484047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-231489d2-9272-4749-91e7-82570de16dcb req-7b5278c4-9228-4ddb-8f24-a3f6b06c8501 service nova] Creating event network-vif-unplugged:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:35:19.489358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-231489d2-9272-4749-91e7-82570de16dcb req-7b5278c4-9228-4ddb-8f24-a3f6b06c8501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036494 Jul 12 14:35:19.490340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 150/334] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:19.621012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:19.622728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:19.629433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.629993 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.630855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.631484 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.656087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:19.656788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:19.663859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.664633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.665446 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.665912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.802114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:19.815292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:19.818064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:19.820025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eaff152f-8526-456d-b248-c176114c4f5f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.202967 Jul 12 14:35:19.829156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 185/335] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:19 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:19.851251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:19.859447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-71477fd4-e3ca-4d93-9b41-641c57e36ff1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.207746 Jul 12 14:35:19.860036 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 151/336] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:19 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:19.940927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:19.941532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:19.947901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.948349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:19.949113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:19.949583 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.085747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:20.093701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8f87c0a3-64cf-4b6f-8f9f-11da58fdf13e tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.156802 Jul 12 14:35:20.094269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 186/337] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:19 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:20.405562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:20.406183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:20.408395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=4 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:20.409157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=16 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:20.415494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.415935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.416740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.417175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.546592 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:20.554165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-01ede957-8b85-468d-a31b-b52b8bc3ec78 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.152787 Jul 12 14:35:20.554721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 152/338] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:20 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:20.847067 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:20.847682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:20.854406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.854854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.856203 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.856640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.876232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:20.876878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:20.883060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.883520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:20.884305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:20.884745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:21.020874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.030379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cf3a97a0-6499-44f3-ae59-0750a20188d2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.157903 Jul 12 14:35:21.030967 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 153/339] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:20 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:21.111629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:21.112289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:21.118918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:21.119366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:21.120200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:21.120581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:21.205750 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.213652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.215222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.216290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3a30b594-2f7e-4ba4-ab0d-ac8d692dfaf9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.373111 Jul 12 14:35:21.216849 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 187/340] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:20 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:21.271073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.279383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1caeecde-ec42-42f4-8615-fd594d4504af tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.171968 Jul 12 14:35:21.279942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 154/341] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:21 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:21.572283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:21.573053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:21.579187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:21.579632 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:21.580387 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:21.580815 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:21.712494 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:21.715264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:21.722084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fcea433f-0f29-4378-b884-5fa95b2383ed tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.154374 Jul 12 14:35:21.722647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 188/342] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:21 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:22.047194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:22.047814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:22.054467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.054920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.055686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.056129 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.189320 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.192782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:22.197860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-452e192b-eb16-4aea-8a15-d4d5f9dbc48c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.154524 Jul 12 14:35:22.198440 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 155/343] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:22 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:22.235185 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:22.235863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:22.242476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.242935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.243747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.244200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.296442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:22.296965 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:22.303028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.303470 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.304223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.304658 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.378504 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.386741 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.388156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.389317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a5f52656-e425-4b2c-81fa-3ea2f72d2fb9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.158942 Jul 12 14:35:22.389892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 189/344] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:22 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:22.448425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.456267 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-001b7784-bbf1-45db-b79c-232b64bad1a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.164104 Jul 12 14:35:22.456823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 156/345] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:22 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:22.739360 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:22.739959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:22.746806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.747253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.748222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:22.748662 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:22.887964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:22.895889 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fa5d1a4e-a408-4243-bf08-ca2057269e3f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.160356 Jul 12 14:35:22.896460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 190/346] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:22 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:23.214383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:23.215535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:23.222609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.222943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.223719 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.224154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.357266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:23.364841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5fda01e9-dde1-4e75-a715-c8e080c69b69 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.154360 Jul 12 14:35:23.365423 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 157/347] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:23 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:23.409474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:23.410084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:23.417890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.418336 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.419106 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.419537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.473924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:23.474454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:23.480840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.481282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.482188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.482626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.563336 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:23.571887 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:23.573479 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:23.585902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-90494eb7-7fb8-4626-92a4-73347e9a0e1a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1718 microversion: 2.20 time: 0.169937 Jul 12 14:35:23.585902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 191/348] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:23 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:23.628017 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:23.636154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fcf71808-2e99-47d1-af1d-222eaf4e20ff tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.166179 Jul 12 14:35:23.637359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 158/349] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:23 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:23.681472 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-dafe72f3-662b-4064-a714-d194fc51b9f2 req-b49cc949-9e86-4a4c-a206-e09b45526c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "name": "network-vif-plugged", "status": "completed", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:23.692718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dafe72f3-662b-4064-a714-d194fc51b9f2 req-b49cc949-9e86-4a4c-a206-e09b45526c6b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.693197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-dafe72f3-662b-4064-a714-d194fc51b9f2 req-b49cc949-9e86-4a4c-a206-e09b45526c6b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.705075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-dafe72f3-662b-4064-a714-d194fc51b9f2 req-b49cc949-9e86-4a4c-a206-e09b45526c6b service nova] Creating event network-vif-plugged:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:35:23.710163 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-dafe72f3-662b-4064-a714-d194fc51b9f2 req-b49cc949-9e86-4a4c-a206-e09b45526c6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 Jul 12 14:35:23.710763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 192/350] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:23.914288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:23.915449 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:23.923012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.924070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:23.925390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:23.926047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.070819 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.079347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6bda2656-f001-415d-a3b1-0b5c0b3edbfb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1522 microversion: 2.1 time: 0.169632 Jul 12 14:35:24.079923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 159/351] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:23 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:24.383548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:24.384283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:24.391647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.392111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.392946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.393475 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.540379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.548829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ded9e8e5-04ff-4583-a857-14f401797de2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.169558 Jul 12 14:35:24.549458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 193/352] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:24 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:24.593528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:24.594145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:24.600648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.601101 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.601900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.602377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.653165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:24.653804 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:24.659937 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.660388 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.661153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.661618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.737891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.747010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.748617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.749943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-827b5508-961f-45e3-91fb-27c0927043b3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1721 microversion: 2.20 time: 0.161039 Jul 12 14:35:24.750506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 160/353] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:24 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:24.768038 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7f4f28-ca23-41c2-94f0-fce47f0a56cf"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:24.769174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:24.775348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.775782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.776548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:24.776987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:24.798427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:24.806064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-83dc3a15-8e6e-4fae-a239-ebffa960d5aa tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.156723 Jul 12 14:35:24.806760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 194/354] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:24 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:25.078348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-de3fbfe8-bcb8-4715-9039-93e1bbcf5e63 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314168 Jul 12 14:35:25.078957 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 161/355] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 12 14:35:24 2022] POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 14:35:25.096398 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:25.097009 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.103337 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.103785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.104564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.104997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.198114 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:25.198951 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.208600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.208600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.208600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.208600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.245315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.260636 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e4d9aa6c-3379-4190-a457-6ac79f9d6989 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1502 microversion: 2.1 time: 0.168167 Jul 12 14:35:25.261652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 195/356] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:25 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:25.281038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:25.281696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.288079 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.288761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.289914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.290836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.330960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0912a234-c41f-4485-9e77-82336feef801 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/action" status: 202 len: 0 microversion: 2.20 time: 0.138339 Jul 12 14:35:25.334670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 162/357] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 14:35:25 2022] POST /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:35:25.341036 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:25.341887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.349841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.349841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.350999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.351455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.446841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.455064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a8ecace4-03ad-4db3-ae06-41b35cf9b530 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1517 microversion: 2.1 time: 0.180291 Jul 12 14:35:25.456107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 196/358] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:25 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:25.513920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.523743 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.525520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.527206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e2f4becf-b534-4f01-9fb2-817a3030d3b4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1747 microversion: 2.20 time: 0.190913 Jul 12 14:35:25.543099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 163/359] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:25 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1747 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:25.574187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:25.581580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.590532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.591625 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.592418 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.593099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.758758 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:25.769368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-07cc69b3-a1e2-4ce9-af64-ae5d1b547118 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.206454 Jul 12 14:35:25.770008 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 197/360] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:25 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:25.824841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:25.825495 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:25.833145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.833655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:25.834439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:25.834876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.003241 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:26.012295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e51bed20-69b6-4dc4-a259-4f3b5487b4a5 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.192084 Jul 12 14:35:26.013233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 164/361] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:25 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:26.547542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:26.548233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:26.554945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.555419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.556183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.556621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.697710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:26.707035 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:26.708631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:26.709840 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3496a937-01d6-427a-80c3-fd8397a1dd9c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1747 microversion: 2.20 time: 0.166102 Jul 12 14:35:26.710499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 198/362] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:26 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:26.787341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:26.787980 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:26.794868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.795318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.796082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.796520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.938754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:26.946089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:26.947144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:26.947439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1a220629-8614-4919-925c-bb640db76171 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.164137 Jul 12 14:35:26.948225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 165/363] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:26 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:26.954157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.954598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.955362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:26.955938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:26.981343 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lazy-loading 'flavor' on Instance uuid 961281e0-0b38-46fe-b815-0482022c76b0 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:35:27.031170 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:27.031843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:27.037850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.038305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.039078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.039513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.106056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-977f89ac-1dd8-4ad4-9e51-805a84e0b103 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/action" status: 200 len: 32 microversion: 2.1 time: 0.164983 Jul 12 14:35:27.110678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 199/364] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:35:26 2022] POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 14:35:27.116754 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:27.117596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:27.124343 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.124797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.125603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.126038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.181162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:27.189096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e023bf2d-88c5-4675-9613-1db5ae034ec9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1260 microversion: 2.1 time: 0.163379 Jul 12 14:35:27.189704 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 166/365] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:27 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:27.265271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:27.272861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4eae5437-9ed9-4b19-ab4b-7d5e469215eb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.160894 Jul 12 14:35:27.273452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 200/366] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:27 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:27.729198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:27.730027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:27.736541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.737215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.738052 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.738526 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.964821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:27.966155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:27.968763 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:27.972424 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.973138 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.974064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:27.974582 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:27.981158 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:27.982791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:27.984230 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-90aab5e4-b763-47d3-80d9-c9c6751343b2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1749 microversion: 2.20 time: 0.259251 Jul 12 14:35:27.984820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 167/367] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:27 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:28.133668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:28.155877 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-790c60fd-ef5e-422c-8ced-3507fda0bce9 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.194971 Jul 12 14:35:28.157949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 201/368] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:27 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:28.205989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:28.206603 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:28.212657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.213106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.213910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.214350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.291067 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:28.291710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:28.298841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.299297 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.300078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.300513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.351135 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:28.354637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:28.371109 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2ad4ba09-0c91-4b13-8929-860ed2b91644 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1445 microversion: 2.1 time: 0.168909 Jul 12 14:35:28.371892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 168/369] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:28 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:28.389427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:28.390340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:28.399739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.400348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.401557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:28.402709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:28.464447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:28.473589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-110158fc-f818-411b-ae9d-12c79d7dd5b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.186462 Jul 12 14:35:28.474164 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 202/370] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:28 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:28.548027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:28.561400 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1126dd36-6798-438d-a95a-b05ce6c5b69c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1445 microversion: 2.1 time: 0.177283 Jul 12 14:35:28.562375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 169/371] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:28 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:29.006252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:29.007018 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:29.013725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.014310 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.015258 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.015794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.178480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:29.179100 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:29.186940 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.187795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.188590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.189200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.208048 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:29.217839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:29.220657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:29.222659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ad106790-113d-4d68-b6e5-ed0229b0f7f4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1749 microversion: 2.20 time: 0.222269 Jul 12 14:35:29.233792 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 203/372] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:28 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1749 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:29.491088 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:29.491732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:29.498263 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.498714 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.499499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.500131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.504617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:29.531071 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:29.541606 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3b0eb8fd-2a87-40f2-b113-da68045188cb tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.366984 Jul 12 14:35:29.546680 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 170/373] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:29 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:29.712742 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:29.726012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-575f5e29-3d37-4b22-88fc-a24d56ba3a0e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.238800 Jul 12 14:35:29.735558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 204/374] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:29 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:29.828658 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-d41c6629-75f2-4a9e-b465-90544d2bcc64 req-4c6428e2-6924-4d12-a9e5-6fbef0c99198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82caa470-858f-4885-aff4-ee0bbea62417", "name": "network-vif-plugged", "status": "completed", "tag": "85b044af-a540-4ed9-bcac-01e0d29b4bb4"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:29.836836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d41c6629-75f2-4a9e-b465-90544d2bcc64 req-4c6428e2-6924-4d12-a9e5-6fbef0c99198 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:29.837346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d41c6629-75f2-4a9e-b465-90544d2bcc64 req-4c6428e2-6924-4d12-a9e5-6fbef0c99198 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:29.852391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-d41c6629-75f2-4a9e-b465-90544d2bcc64 req-4c6428e2-6924-4d12-a9e5-6fbef0c99198 service nova] Creating event network-vif-plugged:85b044af-a540-4ed9-bcac-01e0d29b4bb4 for instance 82caa470-858f-4885-aff4-ee0bbea62417 on hv-cinder-83699 Jul 12 14:35:29.857578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-d41c6629-75f2-4a9e-b465-90544d2bcc64 req-4c6428e2-6924-4d12-a9e5-6fbef0c99198 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032586 Jul 12 14:35:29.858513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 171/375] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:30.241303 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:30.241954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:30.248161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:30.250221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.250713 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.251851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.252195 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.451514 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:30.463011 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:30.466087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:30.468744 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b5f07bef-b9b1-4346-9ac7-a7442494a5c3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1749 microversion: 2.20 time: 0.231462 Jul 12 14:35:30.470292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 205/376] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:30 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1749 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:30.571637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:30.572261 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:30.579079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.579523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.580891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.581348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.743528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:30.744143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:30.750334 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.750788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.751563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:30.752001 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:30.858773 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:30.867144 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9e80db63-ea03-4832-9e67-65c89f4fb69b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.300366 Jul 12 14:35:30.868042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 172/377] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:30 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:30.892516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:30.900214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-121fe8a0-d3b5-4982-8e6e-c70bcc7700c1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.160522 Jul 12 14:35:30.900779 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 206/378] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:30 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:31.232679 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-cf3df3f1-2d08-41f6-8f6b-97230a0c1140 req-7a59166d-15de-4eee-9c37-c367a5db8135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:31.236329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:31.242221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-cf3df3f1-2d08-41f6-8f6b-97230a0c1140 req-7a59166d-15de-4eee-9c37-c367a5db8135 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.242672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-cf3df3f1-2d08-41f6-8f6b-97230a0c1140 req-7a59166d-15de-4eee-9c37-c367a5db8135 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.256133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-cf3df3f1-2d08-41f6-8f6b-97230a0c1140 req-7a59166d-15de-4eee-9c37-c367a5db8135 service nova] Creating event network-changed:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:35:31.261194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-cf3df3f1-2d08-41f6-8f6b-97230a0c1140 req-7a59166d-15de-4eee-9c37-c367a5db8135 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033411 Jul 12 14:35:31.261995 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 173/379] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:35:31.488146 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:31.489699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:31.497452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.498142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.499106 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.499914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.702772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:31.711464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:31.713162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:31.714527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4b2f1a52-be0b-4c23-aa19-28b039688b3c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.230377 Jul 12 14:35:31.715171 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 207/380] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:31 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:31.886232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:31.886959 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:31.894219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.894915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.895923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.896346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.918239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:31.918845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:31.924978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.925728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:31.926496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:31.926940 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:32.035230 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:32.043271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-48fa5c3a-9e7a-4b7c-b5b3-4ada73cd83f5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1264 microversion: 2.1 time: 0.161642 Jul 12 14:35:32.047985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 174/381] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:31 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:32.090707 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:32.098343 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-94a17b0b-4ada-43fd-b0fa-5dcb91821e7c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.184399 Jul 12 14:35:32.098919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 208/382] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:31 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:32.733413 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:32.733932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:32.740010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:32.740458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:32.741219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:32.741678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:32.883572 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:32.892393 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:32.893929 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:32.895080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5f291578-08d3-4ee4-9838-a0362e2afdfe tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.166369 Jul 12 14:35:32.895636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 175/383] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:32 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:33.060130 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:33.060693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:33.068026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.068834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.070535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.070982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.115099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:33.115717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:33.121637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.122294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.122839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.123268 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.209375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:33.216946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6e077d2f-0dd6-4bd7-8e85-de6fe015c769 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1451 microversion: 2.1 time: 0.160998 Jul 12 14:35:33.217528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 209/384] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:33 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:33.235372 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:33.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:33.243992 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.244340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.245181 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.245741 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.284526 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:33.294989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4bb2cb29-0247-45af-9046-eeab672e7de0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.183541 Jul 12 14:35:33.296216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 176/385] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:33 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:33.515474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:33.526779 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-765a6f3d-58d6-4347-8056-a8069f17a343 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1451 microversion: 2.1 time: 0.296982 Jul 12 14:35:33.535046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 210/386] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:33 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1451 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:33.913737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:33.914652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:33.922226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.923001 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:33.923982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:33.924625 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:34.227684 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:34.238118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:34.239620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:34.240965 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1cc047b4-ff7f-45d5-b286-e27c23f15398 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.331337 Jul 12 14:35:34.241715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 177/387] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:33 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:34.315436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:34.319245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:34.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:34.330810 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:34.331688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:34.332199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:34.573550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:34.581623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e9565f16-95d3-4f07-9c15-584d53ebf678 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.270028 Jul 12 14:35:34.582230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 211/388] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:34 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:35.267862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:35.268444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:35.278943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:35.279735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:35.280668 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:35.281888 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:35.430646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:35.440395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:35.443028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:35.444518 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f77b2442-4398-49cc-a1ef-a4c7117ece0a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.180799 Jul 12 14:35:35.445652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 178/389] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:35 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:35.601833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:35.603095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:35.611867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:35.612576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:35.613595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:35.614187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:35.784828 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-394e3d9d-8445-4493-9aec-510c0e6aa60c req-7ca5ee30-7397-4c3d-a035-58af9dbfbf94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82caa470-858f-4885-aff4-ee0bbea62417", "tag": "85b044af-a540-4ed9-bcac-01e0d29b4bb4"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:35.793947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-394e3d9d-8445-4493-9aec-510c0e6aa60c req-7ca5ee30-7397-4c3d-a035-58af9dbfbf94 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:35.794421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-394e3d9d-8445-4493-9aec-510c0e6aa60c req-7ca5ee30-7397-4c3d-a035-58af9dbfbf94 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:35.808596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-394e3d9d-8445-4493-9aec-510c0e6aa60c req-7ca5ee30-7397-4c3d-a035-58af9dbfbf94 service nova] Creating event network-changed:85b044af-a540-4ed9-bcac-01e0d29b4bb4 for instance 82caa470-858f-4885-aff4-ee0bbea62417 on hv-cinder-83699 Jul 12 14:35:35.812354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-394e3d9d-8445-4493-9aec-510c0e6aa60c req-7ca5ee30-7397-4c3d-a035-58af9dbfbf94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031071 Jul 12 14:35:35.813659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 179/390] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:35:35.856465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:35.866955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bea361c4-169e-4318-a141-98049586322a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.271484 Jul 12 14:35:35.867909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 212/391] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:35 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:36.466688 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:36.467501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:36.475169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:36.475344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:36.476330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:36.476769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:36.645161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:36.656786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:36.658705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:36.659960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4dfdcacf-4e50-462b-9abb-5c044b74df48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.200216 Jul 12 14:35:36.661386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 180/392] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:36 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:36.887638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:36.888241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:36.894862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:36.895311 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:36.896084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:36.896516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:37.037370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:37.045974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-147351c2-0508-41a9-a22e-a77d1aad60ba tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.162272 Jul 12 14:35:37.046636 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 213/393] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:36 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:37.679683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:37.680366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:37.688173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:37.688672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:37.689605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:37.690045 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:37.828002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:37.837221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:37.839020 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:37.840316 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ec01effe-35b8-4684-be1c-f9cb6fd0fb8c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.164547 Jul 12 14:35:37.840879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 181/394] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:37 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:38.064447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:38.065120 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:38.072230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:38.072680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:38.073498 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:38.073936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:38.219321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:38.227736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3a4f6cb3-d3f7-4261-91de-c02056aa8e71 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.167526 Jul 12 14:35:38.228888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 214/395] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:38 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:38.859551 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:38.860236 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:38.867223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:38.867730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:38.868463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:38.868904 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:39.020357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:39.029276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:39.031068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:39.032310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bd67430a-dca0-4c7a-92af-4c8371f98f3d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.177249 Jul 12 14:35:39.033089 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 182/396] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:38 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:39.246602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:39.247161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:39.253922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:39.254370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:39.255147 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:39.255579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:39.398970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:39.409497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dbe17771-d3e4-42d6-8881-bcac34e73766 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.167317 Jul 12 14:35:39.410447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 215/397] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:39 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:40.050177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:40.051016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:40.059203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:40.059648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:40.060699 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:40.061128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:40.212991 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:40.222412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:40.224215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:40.225774 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e7e13a15-b39a-41f0-aacc-11abeaa26d9b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.179954 Jul 12 14:35:40.226440 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 183/398] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:40 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:40.427890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:40.428493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:40.436559 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:40.437014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:40.437860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:40.438305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:40.575200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:40.582938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-694dfbb0-3512-43d9-afd7-e78ed3d12846 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.158903 Jul 12 14:35:40.583747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 216/399] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:40 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:41.244205 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:41.244818 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:41.252063 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:41.252870 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:41.253919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:41.254580 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:41.405008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:41.414987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:41.416702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:41.418569 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-df19dd7b-c025-43a5-8e07-734cfd68acd0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.178399 Jul 12 14:35:41.419928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 184/400] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:41 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:41.600247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:41.601118 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:41.608725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:41.609423 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:41.610284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:41.610827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:41.752255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:41.761894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-89760823-1caa-408c-80fa-20eb759006da tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.164574 Jul 12 14:35:41.761894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 217/401] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:41 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:42.437010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:42.437692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:42.444255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:42.444698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:42.445502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:42.445941 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:42.583137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:42.592471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:42.594147 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:42.595318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b1d0a2b5-d70b-4084-b2f1-27d2f3ebc192 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.163179 Jul 12 14:35:42.596077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 185/402] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:42 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:42.778338 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:42.778921 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:42.785970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:42.786410 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:42.787177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:42.787601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:42.925348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:42.933179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c57bd65e-52a0-430f-bc7f-76ac4becbdf8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.159147 Jul 12 14:35:42.934287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 218/403] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:42 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:43.614051 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:43.614742 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:43.621224 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:43.621718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:43.622490 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:43.622926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:43.759855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:43.769186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:43.770730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:43.771902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4c1c8b81-5f1d-4060-b0d6-0da9ef712e75 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.161851 Jul 12 14:35:43.772588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 186/404] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:43 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:43.951303 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:43.951890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:43.958500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:43.958956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:43.959719 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:43.960154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:44.098338 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:44.106221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-842c0cee-f433-4516-beda-0d357e8c9e6e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.158846 Jul 12 14:35:44.107034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 219/405] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:43 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:44.790626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:44.791386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:44.798659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:44.799107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:44.799868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:44.800308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:44.818337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:44.932751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:44.942189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:44.943678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:44.944833 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f94bd955-5f4a-4d7c-89cb-a413eb1a2411 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.158224 Jul 12 14:35:44.945403 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 187/406] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:44 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:45.123801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:45.124412 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:45.130994 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:45.131385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:45.132137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:45.132566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:45.265431 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:45.267712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:45.274186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6dc491b4-8d17-4314-8ecb-d25d1d3cd809 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.154846 Jul 12 14:35:45.274752 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 220/407] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:45 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:45.964996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:45.965643 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:45.972089 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:45.972542 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:45.973354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:45.973798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:46.100217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:46.108532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:46.110060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:46.111209 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6e1a83d6-0e53-4c9a-b028-d9ba99a0228b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.150746 Jul 12 14:35:46.111929 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 188/408] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:45 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:46.291222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:46.291772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:46.298347 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:46.298796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:46.299560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:46.299998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:46.428343 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:46.436635 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6fa95971-6a1d-4860-8207-7af554292761 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.149336 Jul 12 14:35:46.437425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 221/409] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:46 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:35:47.129458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:47.130067 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:47.137137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:47.137613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:47.138383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:47.138818 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:47.269817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:47.278193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:47.279729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:47.280883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bbcaa4d6-9333-440a-940f-4cdbc60b1681 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.155369 Jul 12 14:35:47.281461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 189/410] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:47 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:47.454187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:47.454802 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:47.461320 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:47.461799 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:47.462564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:47.463000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:47.593992 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:47.601463 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b35ea336-f47d-4ed1-ac52-78e8a3e0f763 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.151069 Jul 12 14:35:47.602025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 222/411] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:47 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:48.299151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:48.299766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:48.306291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:48.306762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:48.307517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:48.307946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:48.439493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:48.447840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:48.449979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:48.451174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-161a3bd3-296d-4992-a69f-3fe537997377 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.156119 Jul 12 14:35:48.451693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 190/412] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:48 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:48.619515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:48.621825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:48.630012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:48.630458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:48.631243 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:48.632099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:48.772809 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:48.782175 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8080f141-5a74-4613-8c1c-9f5e8d6c865d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.166787 Jul 12 14:35:48.782737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 223/413] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:48 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:49.469066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:49.469714 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:49.476217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:49.476646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:49.477492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:49.477931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:49.606926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:49.615482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:49.616979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:49.618176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e24e7636-f11a-40cb-a3b8-341aa385336b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.153009 Jul 12 14:35:49.618730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 191/414] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:49 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:49.803418 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:49.804142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:49.815786 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:49.815786 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:49.816549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:49.817302 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:49.948510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:49.955935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1de2265a-c6c9-4661-9f21-ecb811e40eaf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.159301 Jul 12 14:35:49.956492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 224/415] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:49 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:50.636312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:50.636926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:50.643662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:50.644117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:50.644879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:50.645320 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:50.775927 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:50.784929 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:50.786481 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:50.787650 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d46c8c77-4138-4c64-8567-5f7b377aa955 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.155248 Jul 12 14:35:50.788215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 192/416] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:50 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:50.973380 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:50.973909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:50.980912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:50.981379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:50.982145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:50.982583 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:51.124461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:51.131891 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5286d8ac-0e29-4bad-89a3-51ce8d25353c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.162482 Jul 12 14:35:51.132452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 225/417] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:50 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:51.806979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:51.807588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:51.814462 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:51.814939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:51.815757 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:51.816211 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:51.947161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:51.955705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:51.957217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:51.958405 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0543693f-3909-4eaf-a457-3537e96a6bfd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.155391 Jul 12 14:35:51.958961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 193/418] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:51 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:52.149894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:52.150511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:52.157668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:52.158117 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:52.158883 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:52.159322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:52.287592 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:52.295427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7483fb5f-4389-4fec-9800-0ebf14db42bf tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.149385 Jul 12 14:35:52.296025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 226/419] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:52 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:52.977631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:52.978212 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:52.984809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:52.985263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:52.986073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:52.986512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:53.114691 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:53.122993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:53.124489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:53.125673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b5f6e537-ba09-486b-93b0-cfb79b1dc8f0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.152575 Jul 12 14:35:53.126231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 194/420] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:52 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:53.312846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:53.313430 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:53.320052 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:53.320621 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:53.321563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:53.322100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:53.457886 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:53.465511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8302b9e6-884d-4408-a03a-0002346b298c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.157368 Jul 12 14:35:53.466071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 227/421] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:53 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:54.143735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:54.144558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:54.152391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:54.152835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:54.153631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:54.154066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:54.292661 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:54.304759 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:54.306407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:54.307832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d9911105-1479-4073-8f55-de8cf2b7a147 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.168021 Jul 12 14:35:54.308547 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 195/422] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:54 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:54.483064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:54.483671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:54.490165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:54.490601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:54.491357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:54.491788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:54.628475 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:54.637304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-df82272c-755f-4a32-8d4d-5c2ec413077f tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.158039 Jul 12 14:35:54.637892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 228/423] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:54 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:55.326938 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:55.327552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:55.334251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:55.334702 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:55.335525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:55.337130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:55.473851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:55.482407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:55.483961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:55.485119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-076c8622-3117-43a2-9678-8cecd9ac4e9e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.162692 Jul 12 14:35:55.485781 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 196/424] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:55 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:55.654497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:55.655122 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:55.661643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:55.662098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:55.662871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:55.663306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:55.801211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:55.808853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d3161ec8-784d-432b-a813-7d51cdb33df0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.158295 Jul 12 14:35:55.809722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 229/425] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:55 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:56.505461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:56.506083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:56.512642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:56.513100 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:56.513906 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:56.514350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:56.648509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:56.657796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:56.659395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:56.660558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-28f6f1b7-bbf5-44c4-9b62-3afb52fbf5e8 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.159210 Jul 12 14:35:56.661168 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 197/426] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:56 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:56.827796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:56.828410 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:56.835077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:56.835528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:56.836296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:56.836733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:56.983202 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:56.991229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2e289dd1-6ce7-45ed-89cc-abb22a673000 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1503 microversion: 2.1 time: 0.167905 Jul 12 14:35:56.991791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 230/427] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:56 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:57.007836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "496eb14f-af87-4cc0-aec1-7efd94dd16d1"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:57.008925 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:57.014980 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.015421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.016175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.016645 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.039141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] HTTP exception thrown: Cannot 'attach_volume' instance 961281e0-0b38-46fe-b815-0482022c76b0 while it is in vm_state rescued Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Request method failure captured: Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/os-volume_attachments HTTP/1.1 Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 74 Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZctuhuOnn0F060zgZShYesLmWYTZb3V91v33sZDj3CCEn2j51pNFdFnHRdkvf8-nod7Vidl-6iGgdytrdKIn7NQg_FQ77pQ48XRRrNbUJwj3Td3qevlP9zx9PQLp4PudE0Iz3dndnEUYz82HZ3JgD9CvDqLZ-z6c8bzgPEYC9J1Cg Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:35:57.040786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_926f1338d73b48aebc0431e2121a0dba", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: a48066ed22e14c64a316fe4d66394f44 Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {"volumeAttachment": {"volumeId": "496eb14f-af87-4cc0-aec1-7efd94dd16d1"}} Jul 12 14:35:57.042923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Cannot 'attach_volume' instance 961281e0-0b38-46fe-b815-0482022c76b0 while it is in vm_state rescued Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'server_id': '961281e0-0b38-46fe-b815-0482022c76b0', 'body': {'volumeAttachment': {'volumeId': '496eb14f-af87-4cc0-aec1-7efd94dd16d1'}}} Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 961281e0-0b38-46fe-b815-0482022c76b0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:35:57.043958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 961281e0-0b38-46fe-b815-0482022c76b0 while it is in vm_state rescued Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:35:57.045480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 961281e0-0b38-46fe-b815-0482022c76b0 while it is in vm_state rescued Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Returning 409 to user: Cannot 'attach_volume' instance 961281e0-0b38-46fe-b815-0482022c76b0 while it is in vm_state rescued {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ff9e2a5b-d747-4e23-9ee7-593f6e3519d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038340 Jul 12 14:35:57.048317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 198/428] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:35:57 2022] POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:35:57.051654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:57.052181 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:57.058651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.059090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.059846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.060530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.132129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8c2b32b7-3f62-4985-96ed-4344c95ffb5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/action" status: 202 len: 0 microversion: 2.1 time: 0.084068 Jul 12 14:35:57.132750 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 231/429] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:35:57 2022] POST /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:35:57.140864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:57.141516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:57.147699 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.148148 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.148915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.149368 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.347227 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:57.354769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a35f80f0-3822-4a6b-af95-cb428caa67f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1511 microversion: 2.1 time: 0.217666 Jul 12 14:35:57.355337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 199/430] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:57 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:57.680039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:57.680770 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:57.688613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.689065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.689869 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.690307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.816524 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-7c19b554-dba4-47ca-8df5-0577c91c9886 req-1972f51c-f4de-4029-bf27-19a467c92b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "name": "network-vif-plugged", "status": "completed", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:35:57.826299 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-7c19b554-dba4-47ca-8df5-0577c91c9886 req-1972f51c-f4de-4029-bf27-19a467c92b97 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:57.826819 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-7c19b554-dba4-47ca-8df5-0577c91c9886 req-1972f51c-f4de-4029-bf27-19a467c92b97 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:57.838512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:57.847984 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:57.849542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:57.850909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4e67b91f-adbb-4b28-81c9-1c66fdb39898 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.175454 Jul 12 14:35:57.853386 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 232/431] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:57 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:35:57.854233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-7c19b554-dba4-47ca-8df5-0577c91c9886 req-1972f51c-f4de-4029-bf27-19a467c92b97 service nova] Creating event network-vif-plugged:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:35:57.864931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-7c19b554-dba4-47ca-8df5-0577c91c9886 req-1972f51c-f4de-4029-bf27-19a467c92b97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052375 Jul 12 14:35:57.865742 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 200/432] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:35:58.372493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:58.373114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:58.380579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:58.381186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:58.382572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:58.383040 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:58.515728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:58.523180 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-130c4c1b-68bc-4860-9e0f-a441ab3efd17 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1511 microversion: 2.1 time: 0.155070 Jul 12 14:35:58.523733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 233/433] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:58 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:35:58.871506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:58.872207 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:58.878465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:58.878913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:58.879676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:58.880110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:59.015448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:59.027379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:59.028907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:59.030184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a247669e-b4c6-4fbc-9365-3532f0570344 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.164041 Jul 12 14:35:59.030738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 201/434] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:35:58 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:35:59.540711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:35:59.541315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:35:59.548411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:59.548865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:59.549662 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:35:59.550107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:35:59.679046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:35:59.686776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1383ca27-24ed-4f4b-8c27-435b86d68fd9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1511 microversion: 2.1 time: 0.149919 Jul 12 14:35:59.687338 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 234/435] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:35:59 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:00.048987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:00.049625 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:00.056347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:00.056841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:00.057676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:00.058176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:00.187377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:00.196467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:00.198027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:00.199738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9ce79dac-dea1-4196-b9c5-b8824669aaf7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.154791 Jul 12 14:36:00.200300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 202/436] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:00 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:00.704027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:00.704563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:00.707958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=60 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:00.714892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:00.715338 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:00.716103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:00.716537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:00.849385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:00.856863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-09cb5457-41dc-459e-b66c-e424db015e4e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1511 microversion: 2.1 time: 0.156872 Jul 12 14:36:00.857448 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 235/437] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:00 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:01.009154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:01.009624 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.015615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.016178 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.017135 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.017600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.040587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1f5dd973-475f-4a94-8bec-e587cbb427e8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/ips" status: 200 len: 150 microversion: 2.1 time: 0.035293 Jul 12 14:36:01.041138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 203/438] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:36:01 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:01.052042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7517ee81-f7fa-42a7-8787-166e5b261bfa"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:01.053190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.059937 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.060640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.061427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.061867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.075787 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:01.152962 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/os-volume_attachments HTTP/1.1 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 74 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:36:01.154712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {"volumeAttachment": {"volumeId": "7517ee81-f7fa-42a7-8787-166e5b261bfa"}} Jul 12 14:36:01.156231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'server_id': 'e5009617-7468-48d8-81b6-718b0dbd1161', 'body': {'volumeAttachment': {'volumeId': '7517ee81-f7fa-42a7-8787-166e5b261bfa'}}} Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:36:01.157199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:01.158664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 400 to user: Invalid volume: volume 7517ee81-f7fa-42a7-8787-166e5b261bfa is already attached to instances: a632d5e0-9cae-4a5d-9607-4b8f91601de6 {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cfae4f9c-2a0c-4d19-be27-b56aaec5cc40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108096 Jul 12 14:36:01.160201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 236/439] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:36:01 2022] POST /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:36:01.165013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:01.165562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.172700 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.173149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.173949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.174387 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.201075 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:36:01.220586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:01.221212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.228965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.229572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.230628 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:01.231095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.232012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.266520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=64 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:01.282919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-673b7526-fac4-44e7-a618-03a2c83aa37e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 204 len: 0 microversion: 2.1 time: 0.121400 Jul 12 14:36:01.283723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 204/440] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:36:01 2022] DELETE /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:36:01.291829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:01.292553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.298570 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.299018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.299775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.300218 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.380447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:01.390645 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:01.392383 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:01.393661 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ae54d501-df7b-400d-be18-fa9c115aa503 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.178377 Jul 12 14:36:01.394299 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 237/441] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:01 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:36:01.433484 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:01.449927 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8e34a8f2-6ec3-4a80-b5ec-4c4601f8680d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1682 microversion: 2.1 time: 0.162134 Jul 12 14:36:01.450500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 205/442] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:01 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:36:01.874042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:01.874668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:01.881194 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.881697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:01.882520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:01.883002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:02.012631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:02.020197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e18f634-88cd-4cc7-a2f5-e36badf359e7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1517 microversion: 2.1 time: 0.150160 Jul 12 14:36:02.020755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 238/443] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:01 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:02.411855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:02.412615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:02.421288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:02.421777 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:02.422548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:02.422986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:02.467467 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:02.468237 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:02.474744 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:02.475205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:02.475985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:02.476426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:02.553081 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:02.561908 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:02.563436 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:02.564634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5601877f-82e9-4187-bc06-5c3301e54735 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.156862 Jul 12 14:36:02.565608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 206/444] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:02 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:02.614974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:02.623072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e5f376f-cccb-4613-9437-62e6fb466b5a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1682 microversion: 2.1 time: 0.159587 Jul 12 14:36:02.623631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 239/445] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:02 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:36:03.363835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d145adbd-a533-4a84-a6c1-774835319505 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: .version_select at 0x7f01ceb07310>, body: {"keypair": {"name": "tempest-keypair-499898226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJjTiK0FoZyhipsA5zkJikY5L69qa57E5Q4oJnfjUvsbiu2dquMZNAUU8uO3W9Vxsn+CK0Km7tAlsGh7UAFrW/MW5VCOUQYbVtTcCjG+FWavF1h98VBbL5bw2uet/BA2g=="}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:03.378240 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-d145adbd-a533-4a84-a6c1-774835319505 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for project 926f1338d73b48aebc0431e2121a0dba. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:36:03.382334 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-d145adbd-a533-4a84-a6c1-774835319505 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for user a48066ed22e14c64a316fe4d66394f44 and project 926f1338d73b48aebc0431e2121a0dba. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:36:03.408935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d145adbd-a533-4a84-a6c1-774835319505 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049018 Jul 12 14:36:03.409554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 207/446] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:36:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:03.582979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:03.583652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:03.591320 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:03.591761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:03.592549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:03.592977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:03.640543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:03.641162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:03.647390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:03.647840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:03.648617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:03.649152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:03.770037 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:03.779216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:03.780798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:03.782096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-21066104-4d0b-477e-83ab-75c14958eb7f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.203306 Jul 12 14:36:03.782656 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 240/447] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:03 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:03.859615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:03.868395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-99bc1723-8779-4e2a-8380-3af5ed0a7ada tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1682 microversion: 2.1 time: 0.232308 Jul 12 14:36:03.869023 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 208/448] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:03 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:36:04.805903 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:04.806683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:04.810745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-754583620", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "201fc1a4-0f58-499f-9b58-5a3333fb7ca5"}], "security_groups": [{"name": "tempest-securitygroup--713751380"}], "key_name": "tempest-keypair-499898226", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:04.815546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:04.816323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:04.817567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:04.818101 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:04.926527 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] validate_networks() for [('201fc1a4-0f58-499f-9b58-5a3333fb7ca5', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:36:04.997512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:05.006211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:05.007718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:05.009075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2c6376db-2847-44e6-bb0a-244c60259a39 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1805 microversion: 2.20 time: 0.207824 Jul 12 14:36:05.009828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 241/449] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:04 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:05.016832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:05.017702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:05.023913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:05.024365 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:05.025142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:05.025602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:05.177275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:05.186210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-81b25ba6-b43a-4b3b-afe2-8c5234ec9732 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1682 microversion: 2.1 time: 0.175225 Jul 12 14:36:05.186914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 242/450] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:05 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:05.337217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:36:05.337672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:36:05.338138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:36:05.338541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:36:05.339537 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:36:05.348323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:05.348794 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:05.349619 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:05.350048 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:05.366557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:36:05.370553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Getting quotas for user a48066ed22e14c64a316fe4d66394f44 and project 926f1338d73b48aebc0431e2121a0dba. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:36:05.382486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:36:05.384795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:36:05.435344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a5fa2b5e-9c26-4d14-96af-3760abc180c8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.629276 Jul 12 14:36:05.435948 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 209/451] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:36:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:36:05.446129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1f331c86-8dd1-49c7-ba05-b502d7a97280 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:05.446829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1f331c86-8dd1-49c7-ba05-b502d7a97280 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:05.499803 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1f331c86-8dd1-49c7-ba05-b502d7a97280 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:05.506478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1f331c86-8dd1-49c7-ba05-b502d7a97280 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1244 microversion: 2.1 time: 0.064250 Jul 12 14:36:05.507047 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 243/452] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:05 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:06.029356 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:06.031183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:06.038591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.039143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.039992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.040434 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.203297 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:06.203913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:06.210117 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.210575 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.211350 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.211786 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.319208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:06.329958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:06.332732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:06.334219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8d60e962-353d-4bfe-a07b-a78df0f80f26 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1792 microversion: 2.20 time: 0.310161 Jul 12 14:36:06.334781 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 210/453] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:06 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1792 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:06.362643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:06.372688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c65466fb-1251-4327-baa4-f9e403e7d62f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1682 microversion: 2.1 time: 0.173175 Jul 12 14:36:06.374349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 244/454] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:06 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:36:06.523669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:06.524289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:06.530386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.530841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.531765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:06.532259 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:06.618941 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:06.626458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e789ebdc-8b9f-4e86-ab26-c04692f6669a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1296 microversion: 2.1 time: 0.106670 Jul 12 14:36:06.627027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 211/455] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:06 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:07.361746 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b74a4c12-c2d9-4fbd-b5b3-48919b537924 req-839dc3b7-602c-4bef-b1da-9c3d7505cfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5009617-7468-48d8-81b6-718b0dbd1161", "name": "network-vif-deleted", "tag": "8067ccbb-0289-4d76-be75-8d3f2b7d1fa5"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:07.371030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b74a4c12-c2d9-4fbd-b5b3-48919b537924 req-839dc3b7-602c-4bef-b1da-9c3d7505cfe4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:07.371468 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b74a4c12-c2d9-4fbd-b5b3-48919b537924 req-839dc3b7-602c-4bef-b1da-9c3d7505cfe4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:07.382762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b74a4c12-c2d9-4fbd-b5b3-48919b537924 req-839dc3b7-602c-4bef-b1da-9c3d7505cfe4 service nova] Creating event network-vif-deleted:8067ccbb-0289-4d76-be75-8d3f2b7d1fa5 for instance e5009617-7468-48d8-81b6-718b0dbd1161 on hv-cinder-83699 Jul 12 14:36:07.388647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b74a4c12-c2d9-4fbd-b5b3-48919b537924 req-839dc3b7-602c-4bef-b1da-9c3d7505cfe4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030600 Jul 12 14:36:07.389758 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 245/456] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:07.390773 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:07.391486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:07.398676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:07.399138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:07.399922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:07.400366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:07.482157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:07.489968 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4ac9ec64-9557-415c-95eb-79de9eccebce tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 200 len: 1615 microversion: 2.1 time: 0.102949 Jul 12 14:36:07.490543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 212/457] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:07 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:07.644902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:07.645624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:07.671851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:07.672577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:07.673591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:07.674643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:07.760356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:07.769353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ba4852b0-3e92-45f8-8f38-631cceb26f6d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1302 microversion: 2.1 time: 0.128606 Jul 12 14:36:07.770455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 246/458] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:07 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:08.508829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:08.509492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:08.516854 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:08.517543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:08.518532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:08.518954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:08.535385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 HTTP/1.1 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:36:08.537358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:36:08.539016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'e5009617-7468-48d8-81b6-718b0dbd1161'} Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:36:08.539896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:36:08.541197 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:08.543960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:36:08.545054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cce735cc-81dd-44ef-ab23-49ab201e9a77 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 404 len: 111 microversion: 2.1 time: 0.040583 Jul 12 14:36:08.546110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 213/459] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:08 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:36:08.554326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bde02a80-3eb2-49f7-84f7-c047b39a1395 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '.version_select at 0x7f01caa9c310>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:08.592271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bde02a80-3eb2-49f7-84f7-c047b39a1395 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409549376" status: 202 len: 0 microversion: 2.1 time: 0.041818 Jul 12 14:36:08.606853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 247/460] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 14:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409549376 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:36:08.788017 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:08.788805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:08.797431 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:08.798247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:08.799521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:08.800058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.152627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:09.163436 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e2b5c1d5-2a32-4ca9-bd76-07c73e8d7bd0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.380366 Jul 12 14:36:09.164360 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 214/461] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:08 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:09.430797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-245bb7d7-b232-4299-bd1f-81e63cfd09e6 req-fc461da9-abeb-4857-bdc2-8848f8bbd170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:09.441174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-245bb7d7-b232-4299-bd1f-81e63cfd09e6 req-fc461da9-abeb-4857-bdc2-8848f8bbd170 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:09.441763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-245bb7d7-b232-4299-bd1f-81e63cfd09e6 req-fc461da9-abeb-4857-bdc2-8848f8bbd170 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.453825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-245bb7d7-b232-4299-bd1f-81e63cfd09e6 req-fc461da9-abeb-4857-bdc2-8848f8bbd170 service nova] Creating event network-changed:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:36:09.468231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-245bb7d7-b232-4299-bd1f-81e63cfd09e6 req-fc461da9-abeb-4857-bdc2-8848f8bbd170 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041670 Jul 12 14:36:09.469711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 248/462] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:09.666768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:09.667302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:09.673767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:09.674218 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.674993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:09.675429 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.802279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lazy-loading 'services' on Instance uuid a632d5e0-9cae-4a5d-9607-4b8f91601de6 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:36:09.915232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-77237210-570a-400b-887a-daf8175808b2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments/7517ee81-f7fa-42a7-8787-166e5b261bfa" status: 202 len: 0 microversion: 2.1 time: 0.252450 Jul 12 14:36:09.915849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 215/463] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:36:09 2022] DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments/7517ee81-f7fa-42a7-8787-166e5b261bfa => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:36:09.925671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:09.926688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:09.934290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:09.934958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.936189 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:09.936627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:09.968367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebaa3c0c-5c89-4408-899d-0237612a6f37 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Jul 12 14:36:09.968938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 249/464] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:36:09 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:10.180561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:10.181300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:10.188406 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:10.188860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:10.189667 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:10.190105 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:10.321102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:10.329246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-92073093-5e24-4919-9b11-b4cceb710d42 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.152948 Jul 12 14:36:10.329860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 216/465] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:10 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:10.980561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:10.981558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:10.987986 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:10.988434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:10.989191 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:10.989651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:11.019019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-02d74cc3-4588-45ac-8b06-5d7aacb9ff31 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Jul 12 14:36:11.019556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 250/466] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:36:10 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:11.345990 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:11.346639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:11.353358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:11.353876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:11.355187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:11.355644 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:11.519140 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:11.526588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-341a4454-f4f4-4805-b1ed-450d6971f4e6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.184480 Jul 12 14:36:11.527145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 217/467] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:11 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:12.031523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:12.032410 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:12.040256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:12.041134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:12.042238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:12.042680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:12.071858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b55ce186-4e96-4f04-b3b8-9325d3214b3c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jul 12 14:36:12.072420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 251/468] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:36:12 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:12.543337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:12.543954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:12.550407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:12.550857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:12.551620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:12.552059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:12.680415 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:12.688613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9bc84973-19cb-49c9-9dd1-c16e472ffdf1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.149227 Jul 12 14:36:12.689161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 218/469] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:12 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:13.084104 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:13.085025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:13.092052 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.092577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.093352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.093789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.120860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4ef13ddc-7866-4d2d-a128-c235e6012cbd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040725 Jul 12 14:36:13.121418 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 252/470] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:36:13 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:36:13.177912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:13.178405 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:13.184887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.185625 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.190458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.190921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.215510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:36:13.288609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0c7eb155-70e0-4bd8-9018-48c7314b5bb0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 204 len: 0 microversion: 2.1 time: 0.114783 Jul 12 14:36:13.289191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 219/471] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:36:13 2022] DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:36:13.297598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:13.298216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:13.304160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.304607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.305404 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.305825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.436427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:13.443885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1c2f082c-6d28-4d59-bf83-06ef7dbbb14f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1681 microversion: 2.1 time: 0.150390 Jul 12 14:36:13.444440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 253/472] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:13 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:13.706228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:13.706842 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:13.714505 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.714958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.715729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:13.716190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:13.735327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:13.850471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:13.858517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2ef1d1e9-c28f-4cf5-b08c-1210164f6664 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.156846 Jul 12 14:36:13.859087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 220/473] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:13 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:14.461449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:14.462073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:14.468701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:14.469181 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:14.469991 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:14.470429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:14.599562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:14.607638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-44d1e430-d39c-4320-a21b-b9266d5e5115 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1681 microversion: 2.1 time: 0.150092 Jul 12 14:36:14.608221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 254/474] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:14 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:14.874681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:14.875404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:14.881848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:14.882395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:14.883156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:14.883745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:15.014322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:15.021846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c672a871-4b62-483f-a4a6-09c27c88b00e tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.150972 Jul 12 14:36:15.022405 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 221/475] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:14 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:15.624783 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:15.625424 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:15.627895 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:15.633377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:15.633829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:15.634591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:15.635023 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:15.766537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:15.774095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c88ea9c3-3a5c-4858-8258-020dae7261d5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1681 microversion: 2.1 time: 0.153194 Jul 12 14:36:15.774666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 255/476] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:15 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:15.908433 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-f77ac44c-fbf0-4cc2-ae73-5b2fc7156d72 req-27910faa-d1bd-4235-9d4d-f0ce1839c7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "name": "network-vif-plugged", "status": "completed", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:15.915947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:15.916935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=10 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:15.924041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-f77ac44c-fbf0-4cc2-ae73-5b2fc7156d72 req-27910faa-d1bd-4235-9d4d-f0ce1839c7d4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:15.925062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-f77ac44c-fbf0-4cc2-ae73-5b2fc7156d72 req-27910faa-d1bd-4235-9d4d-f0ce1839c7d4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:15.942065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-f77ac44c-fbf0-4cc2-ae73-5b2fc7156d72 req-27910faa-d1bd-4235-9d4d-f0ce1839c7d4 service nova] Creating event network-vif-plugged:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:36:15.956048 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-f77ac44c-fbf0-4cc2-ae73-5b2fc7156d72 req-27910faa-d1bd-4235-9d4d-f0ce1839c7d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052462 Jul 12 14:36:15.956660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 222/477] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:36:16.039261 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:16.039930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:16.045998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:16.046450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:16.047219 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:16.047690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:16.070847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:16.199026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:16.206678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8d0954f6-6862-44ad-acc4-f6b1277689d4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.171388 Jul 12 14:36:16.207268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 256/478] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:16 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:16.793205 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:16.793829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:16.800350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:16.800803 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:16.801646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:16.802083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:17.000625 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:17.009444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5928da06-0b25-4a37-ab83-06f9a26af334 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1614 microversion: 2.1 time: 0.220708 Jul 12 14:36:17.010333 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 223/479] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:16 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1614 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:17.073973 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-64324c5f-d85d-44ab-a812-0e57ee10e724 req-645fbf5c-b395-4048-9e3e-d36ff86af08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632d5e0-9cae-4a5d-9607-4b8f91601de6", "name": "network-vif-deleted", "tag": "54c4615b-3a44-4b7d-a5d9-a95f0077ce44"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:17.082377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-64324c5f-d85d-44ab-a812-0e57ee10e724 req-645fbf5c-b395-4048-9e3e-d36ff86af08f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:17.082825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-64324c5f-d85d-44ab-a812-0e57ee10e724 req-645fbf5c-b395-4048-9e3e-d36ff86af08f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:17.093591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-64324c5f-d85d-44ab-a812-0e57ee10e724 req-645fbf5c-b395-4048-9e3e-d36ff86af08f service nova] Creating event network-vif-deleted:54c4615b-3a44-4b7d-a5d9-a95f0077ce44 for instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 on hv-cinder-83699 Jul 12 14:36:17.098540 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-64324c5f-d85d-44ab-a812-0e57ee10e724 req-645fbf5c-b395-4048-9e3e-d36ff86af08f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028784 Jul 12 14:36:17.099125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 257/480] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:17.223921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:17.224543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:17.231131 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:17.231882 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:17.232788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:17.233132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:17.371746 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:17.379786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-44ee9f3c-4e7a-4303-8d2b-ae2a88375403 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1369 microversion: 2.1 time: 0.159717 Jul 12 14:36:17.394143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 224/481] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:17 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:18.028388 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:18.028995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:18.035808 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.036253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.037030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.037496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.074710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.075284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.075743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lazy-loading 'fault' on Instance uuid a632d5e0-9cae-4a5d-9607-4b8f91601de6 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:36:18.121249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:18.128827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0c9cb8a0-159d-4c5c-83c8-3009d2f9a36e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 200 len: 1331 microversion: 2.1 time: 0.104862 Jul 12 14:36:18.129413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 258/482] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:18 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:18.401877 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:18.402506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:18.409076 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.409573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.410349 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.410792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.537064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:18.545022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-712c49e4-7201-4146-bb0c-be62b85f1c29 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1563 microversion: 2.1 time: 0.147187 Jul 12 14:36:18.545673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 225/483] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:18 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:18.561978 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:18.562466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:18.568331 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.568771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.569565 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:18.569996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:18.644904 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b75a8457-72f0-4354-8d9f-6751afc1e154 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087648 Jul 12 14:36:18.645529 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 259/484] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:36:18 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:19.146515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:19.147123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:19.154238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:19.154825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:19.155674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:19.156240 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:19.172912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 HTTP/1.1 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:36:19.175239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:36:19.176864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'a632d5e0-9cae-4a5d-9607-4b8f91601de6'} Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:36:19.177696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:36:19.179663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:36:19.181399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:36:19.181399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-429a435c-aa02-45d4-94f7-aa26744b3a1e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 404 len: 111 microversion: 2.1 time: 0.034640 Jul 12 14:36:19.181399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 226/485] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:19 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:36:19.187859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d9767532-8b9a-434c-9ae6-bca16967df25 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '.version_select at 0x7f01cad39820>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:19.205517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d9767532-8b9a-434c-9ae6-bca16967df25 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467216431" status: 202 len: 0 microversion: 2.1 time: 0.022902 Jul 12 14:36:19.206370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 260/486] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 14:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467216431 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:36:19.602329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-2bbc7828-1bc4-45db-ab1c-8cf54c8924d1 req-8f9dd5f5-6165-4e37-aa05-86fb8c277e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:19.612626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2bbc7828-1bc4-45db-ab1c-8cf54c8924d1 req-8f9dd5f5-6165-4e37-aa05-86fb8c277e58 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:19.613085 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2bbc7828-1bc4-45db-ab1c-8cf54c8924d1 req-8f9dd5f5-6165-4e37-aa05-86fb8c277e58 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:19.624318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-2bbc7828-1bc4-45db-ab1c-8cf54c8924d1 req-8f9dd5f5-6165-4e37-aa05-86fb8c277e58 service nova] Creating event network-changed:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:36:19.629164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-2bbc7828-1bc4-45db-ab1c-8cf54c8924d1 req-8f9dd5f5-6165-4e37-aa05-86fb8c277e58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031123 Jul 12 14:36:19.632801 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 227/487] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:19.970639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ffe83d29-c0af-476b-8600-ed68205f2da1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: .version_select at 0x7f01caa44700>, body: {"keypair": {"name": "tempest-keypair-1753911916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6eac2mQiFvBEK5t1xY6EgJc//Aq0v6DtSDfHDNI+uJtX3tt5GW20FC2AG++Ma6u5DRps3WMmxZhgPx4JWZDDKM5yxTUj1Gg9CQ8ncpDBQ3eniDxW/kUKpOw31ptbQBBg=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:19.984611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-ffe83d29-c0af-476b-8600-ed68205f2da1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:36:19.988487 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-ffe83d29-c0af-476b-8600-ed68205f2da1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:36:20.013715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ffe83d29-c0af-476b-8600-ed68205f2da1 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046919 Jul 12 14:36:20.014600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 261/488] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:36:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:21.405868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-724731133", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d70325-149a-4db6-bab3-e97d17656939"}], "security_groups": [{"name": "tempest-securitygroup--2032574703"}], "key_name": "tempest-keypair-1753911916", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:21.506063 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] validate_networks() for [('81d70325-149a-4db6-bab3-e97d17656939', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:36:21.872550 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:36:21.872975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:36:21.873509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:36:21.873919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:36:21.874331 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:36:21.883254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:21.883708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:21.884511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:21.884952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:21.901451 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:36:21.905397 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:36:21.916326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:36:21.919313 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:36:21.939078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:21.966492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b4ce0aa7-c4db-4c52-b40d-58d8345a486f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566256 Jul 12 14:36:21.967128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 228/489] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:36:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:36:21.977893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee7cebf6-e0dc-444b-8a0c-3e8e21179fec tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:21.978510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ee7cebf6-e0dc-444b-8a0c-3e8e21179fec tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:22.035340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ee7cebf6-e0dc-444b-8a0c-3e8e21179fec tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:22.042819 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ee7cebf6-e0dc-444b-8a0c-3e8e21179fec tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1241 microversion: 2.1 time: 0.069381 Jul 12 14:36:22.043438 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 262/490] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:21 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:23.064089 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:23.064715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:23.072873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:23.073325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:23.074157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:23.074596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:23.136571 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:23.143478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7665538d-9779-441c-826c-204935e9a343 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1293 microversion: 2.1 time: 0.086046 Jul 12 14:36:23.144242 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 229/491] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:23 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:24.161416 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:24.162041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:24.170871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:24.171599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:24.172429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:24.172870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:24.520153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:24.529532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-828bfdb2-a84e-4027-b33c-b738132fe268 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.371899 Jul 12 14:36:24.530560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 263/492] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:24 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:24.774475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-ca3972ab-c98c-4fda-9a07-382655085807 req-d269e3e5-f39a-4603-b950-e66a3140715b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d33678-1a9f-4331-8d26-8393eb80bcdf", "tag": "0137cf9d-0533-4bde-8468-52e3982d7b08"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:24.785479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ca3972ab-c98c-4fda-9a07-382655085807 req-d269e3e5-f39a-4603-b950-e66a3140715b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:24.793936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ca3972ab-c98c-4fda-9a07-382655085807 req-d269e3e5-f39a-4603-b950-e66a3140715b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:24.808861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-ca3972ab-c98c-4fda-9a07-382655085807 req-d269e3e5-f39a-4603-b950-e66a3140715b service nova] Creating event network-changed:0137cf9d-0533-4bde-8468-52e3982d7b08 for instance 90d33678-1a9f-4331-8d26-8393eb80bcdf on hv-cinder-83699 Jul 12 14:36:24.813931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-ca3972ab-c98c-4fda-9a07-382655085807 req-d269e3e5-f39a-4603-b950-e66a3140715b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043339 Jul 12 14:36:24.814528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 230/493] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:25.547501 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:25.548073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:25.554630 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:25.555089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:25.555851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:25.556291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:25.682854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:25.690881 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f59a0b32-edd5-4865-84e6-bb8004f6ce93 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.147296 Jul 12 14:36:25.691455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 264/494] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:25 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:26.708949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:26.709678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:26.715974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:26.716431 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:26.717258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:26.717662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:26.885256 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:26.893056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-acd0ed77-b2ee-4ad1-ab35-b150131ece6b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.189069 Jul 12 14:36:26.893668 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 231/495] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:26 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:27.910130 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:27.910742 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:27.917205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:27.917692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:27.918446 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:27.918876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:28.055548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:28.063546 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7c098bff-904c-4303-ba17-811cd6705c8c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.157263 Jul 12 14:36:28.064593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 265/496] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:27 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:29.081311 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:29.081947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:29.088907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:29.089374 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:29.090253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:29.090729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:29.220200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:29.227989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-03f091aa-324e-4c35-8641-b717cea499e7 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.150785 Jul 12 14:36:29.228542 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 232/497] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:29 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:29.981871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-e14382fa-cc51-463d-a25f-51b304d6f33f req-f211b37b-037d-4147-9f90-4acfe44236d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d33678-1a9f-4331-8d26-8393eb80bcdf", "name": "network-vif-plugged", "status": "completed", "tag": "0137cf9d-0533-4bde-8468-52e3982d7b08"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:29.991258 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e14382fa-cc51-463d-a25f-51b304d6f33f req-f211b37b-037d-4147-9f90-4acfe44236d7 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:29.991908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e14382fa-cc51-463d-a25f-51b304d6f33f req-f211b37b-037d-4147-9f90-4acfe44236d7 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:30.004646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-e14382fa-cc51-463d-a25f-51b304d6f33f req-f211b37b-037d-4147-9f90-4acfe44236d7 service nova] Creating event network-vif-plugged:0137cf9d-0533-4bde-8468-52e3982d7b08 for instance 90d33678-1a9f-4331-8d26-8393eb80bcdf on hv-cinder-83699 Jul 12 14:36:30.009880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-e14382fa-cc51-463d-a25f-51b304d6f33f req-f211b37b-037d-4147-9f90-4acfe44236d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Jul 12 14:36:30.011558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 266/498] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:30.246490 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:30.247150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:30.254368 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:30.254818 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:30.255593 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:30.256030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:30.392497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:30.399918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c91e45bf-0b24-491d-a38e-22675bea0d67 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.158009 Jul 12 14:36:30.400478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 233/499] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:30 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:31.417522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:31.418561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:31.420947 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:31.426455 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:31.426898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:31.427656 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:31.428086 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:31.557256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:31.564927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b7b346e9-1278-4bbf-841e-87c139034052 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1367 microversion: 2.1 time: 0.152436 Jul 12 14:36:31.565530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 267/500] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:31 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:32.581651 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:32.582259 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:32.584681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:32.585460 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:32.591502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:32.591943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:32.592692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:32.593122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:32.772668 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:32.780864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-635d9408-08a2-42e6-89b2-e74b2314bf9e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1556 microversion: 2.1 time: 0.203025 Jul 12 14:36:32.781451 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 234/501] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:36:32 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:36:32.797820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:32.798363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:32.802193 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:32.806581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:32.807028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:32.807800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:32.808223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:32.889137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5f422ae8-71cc-4231-82a9-2bbc61f0ea6d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095037 Jul 12 14:36:32.889872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 268/502] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:36:32 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:34.235436 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-57f3b6f4-c3f5-47e1-ac05-f537af3c18cf req-59b989f8-d446-4e44-b186-e2c6e2f60700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d33678-1a9f-4331-8d26-8393eb80bcdf", "tag": "0137cf9d-0533-4bde-8468-52e3982d7b08"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:36:34.243907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-57f3b6f4-c3f5-47e1-ac05-f537af3c18cf req-59b989f8-d446-4e44-b186-e2c6e2f60700 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:34.244375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-57f3b6f4-c3f5-47e1-ac05-f537af3c18cf req-59b989f8-d446-4e44-b186-e2c6e2f60700 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:34.254918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-57f3b6f4-c3f5-47e1-ac05-f537af3c18cf req-59b989f8-d446-4e44-b186-e2c6e2f60700 service nova] Creating event network-changed:0137cf9d-0533-4bde-8468-52e3982d7b08 for instance 90d33678-1a9f-4331-8d26-8393eb80bcdf on hv-cinder-83699 Jul 12 14:36:34.259837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-57f3b6f4-c3f5-47e1-ac05-f537af3c18cf req-59b989f8-d446-4e44-b186-e2c6e2f60700 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028084 Jul 12 14:36:34.260590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 235/503] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:36:55.251516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:55.252312 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=47 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:55.256871 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:55.257388 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:55.264150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.264593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.265374 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.265812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.298160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e4f05dc-3d50-4451-adbb-9e9af2e5c019 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments/0f7f4f28-ca23-41c2-94f0-fce47f0a56cf" status: 200 len: 194 microversion: 2.20 time: 0.048031 Jul 12 14:36:55.298729 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 269/504] 10.222.0.25 () {60 vars in 1453 bytes} [Tue Jul 12 14:36:55 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments/0f7f4f28-ca23-41c2-94f0-fce47f0a56cf => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:36:55.360355 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=14 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:55.361096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=68 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:36:55.365461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:55.366046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:55.373909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.374360 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.375128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.375565 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.454363 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lazy-loading 'services' on Instance uuid 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:36:55.527384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9c9fe622-0883-4a6e-8753-d1a4856b91c7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments/0f7f4f28-ca23-41c2-94f0-fce47f0a56cf" status: 202 len: 0 microversion: 2.20 time: 0.170007 Jul 12 14:36:55.527973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 236/505] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 12 14:36:55 2022] DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments/0f7f4f28-ca23-41c2-94f0-fce47f0a56cf => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:36:55.536269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:55.537187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:55.543411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.543859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.544627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:55.545078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:55.581147 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54d0ac1d-9c3f-42f4-b2a8-3b0dca59cd41 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048759 Jul 12 14:36:55.581751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 270/506] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 14:36:55 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:36:56.595104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:56.596148 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:56.602587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:56.603035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:56.603851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:56.604282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:56.632605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a8c74453-4d27-4a23-aaa4-a97e920491e3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042272 Jul 12 14:36:56.633072 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 237/507] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 14:36:56 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:36:57.644907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:57.645886 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:57.652426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.652874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.653660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.654100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.682734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6445e47b-8f07-46c6-9349-7ce866edb84f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041905 Jul 12 14:36:57.683204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 271/508] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 14:36:57 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:36:57.739786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:57.740282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:57.746973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.747426 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.748185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.748620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.772614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:36:57.849944 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ac5208f7-4ee2-443c-b9da-0da2567e90ea tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 204 len: 0 microversion: 2.20 time: 0.113759 Jul 12 14:36:57.850548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 238/509] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 14:36:57 2022] DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:36:57.859143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:57.859751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:57.865750 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.866202 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.866959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:57.867391 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:57.994972 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:58.002817 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:58.004321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:58.005491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-38583e0c-a0bb-4cf8-a5a7-7c7ee8281976 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.150207 Jul 12 14:36:58.006036 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 272/510] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:57 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:36:59.024518 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:36:59.025736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:36:59.032196 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:59.032645 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:59.033435 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:36:59.033872 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:36:59.167989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:59.175843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:59.177354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:36:59.178502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d2d5993d-57ad-4320-a902-d86c9035dc02 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.158298 Jul 12 14:36:59.179050 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 239/511] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:36:59 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:00.197572 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:00.198113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:00.204511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:00.204953 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:00.205744 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:00.206179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:00.336729 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:00.344858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:00.346411 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:00.347581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9d878f99-ebf2-4eaa-9fce-4a3d1fa59be1 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1720 microversion: 2.20 time: 0.154189 Jul 12 14:37:00.348137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 273/512] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:00 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:00.727063 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-c2ec7bc6-5bf8-4883-82c2-b29c844c4a15 req-e037cd22-6a83-41d6-8798-350d3860f0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99794eb0-cb27-44f8-8d77-3ab2377fb8b6", "name": "network-vif-deleted", "tag": "b9f9b222-5c14-49ff-9a28-2b5f0910b85a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:00.738327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c2ec7bc6-5bf8-4883-82c2-b29c844c4a15 req-e037cd22-6a83-41d6-8798-350d3860f0b0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:00.738863 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c2ec7bc6-5bf8-4883-82c2-b29c844c4a15 req-e037cd22-6a83-41d6-8798-350d3860f0b0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:00.756098 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-c2ec7bc6-5bf8-4883-82c2-b29c844c4a15 req-e037cd22-6a83-41d6-8798-350d3860f0b0 service nova] Creating event network-vif-deleted:b9f9b222-5c14-49ff-9a28-2b5f0910b85a for instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 on hv-cinder-83699 Jul 12 14:37:00.761344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-c2ec7bc6-5bf8-4883-82c2-b29c844c4a15 req-e037cd22-6a83-41d6-8798-350d3860f0b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037880 Jul 12 14:37:00.762146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 240/513] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:01.366715 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:01.367429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:01.374481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:01.375013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:01.375860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:01.376364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:01.425859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:01.426313 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:01.426790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lazy-loading 'fault' on Instance uuid 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:37:01.473186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:01.481602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:01.483109 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:01.484268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c0e3e948-7390-4b06-bf5d-5a0ed0f4e2da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 200 len: 1370 microversion: 2.20 time: 0.121518 Jul 12 14:37:01.484830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 274/514] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:01 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 1370 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:02.503247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:02.503947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:02.510745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:02.511193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:02.511951 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:02.512386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:02.525838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 HTTP/1.1 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:37:02.527432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:37:02.528921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '99794eb0-cb27-44f8-8d77-3ab2377fb8b6'} Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:37:02.529847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:37:02.531416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:02.533018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:37:02.533018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e4c2eb8c-15cc-4f95-9080-00623582d13e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 404 len: 111 microversion: 2.20 time: 0.030285 Jul 12 14:37:02.533018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 241/515] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:02 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:37:02.537716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-505fd587-23ce-481a-b9c3-0ddf7077d26c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '.version_select at 0x7f01caddf310>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:02.554535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-505fd587-23ce-481a-b9c3-0ddf7077d26c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688859604" status: 204 len: 0 microversion: 2.20 time: 0.020640 Jul 12 14:37:02.555078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 275/516] 10.222.0.25 () {60 vars in 1258 bytes} [Tue Jul 12 14:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688859604 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:37:03.182118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-886b6db8-3f77-40b9-ae93-6ca0cee24ae0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: .version_select at 0x7f01ceb01160>, body: {"keypair": {"name": "tempest-keypair-1558620975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvkVs+Kt5KDOVWOkfOvSf3fSf4pr0L7AcZzHdsohhj6w/ISNMYUenOiT7xrbvmEq7rhr5BY9y+a2OJHZAb5WJMGykaX9Y+86nMcKhWFh/bqFyFfDHEwRiAmPacQhd367A=="}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:03.195969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-886b6db8-3f77-40b9-ae93-6ca0cee24ae0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:37:03.200263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-886b6db8-3f77-40b9-ae93-6ca0cee24ae0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for user 3753498f22d5443ab0c01473c91a263c and project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:37:03.221757 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-886b6db8-3f77-40b9-ae93-6ca0cee24ae0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043653 Jul 12 14:37:03.222324 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 242/517] 10.222.0.25 () {62 vars in 1199 bytes} [Tue Jul 12 14:37:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 14:37:04.483480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-803743661", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06565c91-0787-49b2-b9d2-af1832defa90"}], "security_groups": [{"name": "tempest-securitygroup--2091909426"}], "key_name": "tempest-keypair-1558620975", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:04.590039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] validate_networks() for [('06565c91-0787-49b2-b9d2-af1832defa90', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:37:04.960645 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:37:04.961068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:37:04.961585 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:37:04.961996 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:37:04.962918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:37:04.971761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:04.972213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:04.973010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:04.973490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:04.990502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:37:04.994380 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Getting quotas for user 3753498f22d5443ab0c01473c91a263c and project 7122215625b64963ab03b66f4c9d8a7f. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:37:05.005131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:37:05.007371 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:37:05.053910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6ac802d7-e5c3-4204-8159-975b536740a7 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575723 Jul 12 14:37:05.054554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 276/518] 10.222.0.25 () {62 vars in 1187 bytes} [Tue Jul 12 14:37:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 14:37:05.066329 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:05.067173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:05.123946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:05.132029 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:05.133955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:05.135727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2742d142-0db7-4f38-bbec-390b1fbd22f2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1281 microversion: 2.20 time: 0.073827 Jul 12 14:37:05.136313 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 243/519] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:05 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:06.154520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:06.155205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:06.162837 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:06.163297 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:06.164083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:06.164522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:06.235576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:06.244085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:06.245640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:06.246745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-30c199d0-d535-46e7-9aa4-5363aa643bcd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1351 microversion: 2.20 time: 0.097160 Jul 12 14:37:06.247326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 277/520] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:06 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:06.390150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaa6889b-f822-471d-940b-02dbc1a49239"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:06.391214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:06.397735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:06.398184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:06.398940 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:06.399369 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:06.683444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b7dbb2b8-af7c-406c-8d2d-c7ec1b79bcc8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297135 Jul 12 14:37:06.688958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 244/521] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:37:06 2022] POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:07.264780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:07.265323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:07.272112 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:07.272566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:07.273352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:07.273810 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:07.408172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:07.423135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:07.424645 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:07.426147 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-498fa29c-3471-41b3-996a-fa53726794bd tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.165277 Jul 12 14:37:07.426584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 278/522] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:07 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:07.920463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-bd87aa1c-6fbd-4ec4-b8c9-326f298909e7 req-b15b57c5-0eb8-40ab-9db6-ae47bd73c6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:07.942303 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-bd87aa1c-6fbd-4ec4-b8c9-326f298909e7 req-b15b57c5-0eb8-40ab-9db6-ae47bd73c6c7 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:07.942835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-bd87aa1c-6fbd-4ec4-b8c9-326f298909e7 req-b15b57c5-0eb8-40ab-9db6-ae47bd73c6c7 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:07.955402 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-bd87aa1c-6fbd-4ec4-b8c9-326f298909e7 req-b15b57c5-0eb8-40ab-9db6-ae47bd73c6c7 service nova] Creating event network-changed:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:37:07.963930 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-bd87aa1c-6fbd-4ec4-b8c9-326f298909e7 req-b15b57c5-0eb8-40ab-9db6-ae47bd73c6c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048693 Jul 12 14:37:07.965279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 245/523] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:08.446995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:08.447612 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:08.454332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:08.454790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:08.455567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:08.456010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:08.584000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:08.592588 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:08.594122 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:08.595229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b57682e9-d07c-49a9-8c41-6815158b28b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.152225 Jul 12 14:37:08.595785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 279/524] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:08 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:09.614058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:09.614753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:09.621934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:09.623635 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:09.624416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:09.624860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:09.831169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:09.839295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:09.840808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:09.841973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-29db946a-7deb-4d80-95b7-bd5710a76a76 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.232245 Jul 12 14:37:09.842531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 246/525] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:09 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:10.859534 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:10.860148 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:10.866688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:10.867137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:10.867893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:10.868327 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:11.002316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:11.010921 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:11.012429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:11.013594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fbafcfba-bffe-4d0d-b283-2e64d078092a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.157965 Jul 12 14:37:11.014148 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 280/526] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:10 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:12.031870 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:12.032497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:12.039194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:12.039711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:12.041190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:12.041733 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:12.173412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:12.181421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:12.182839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:12.183947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5a0d92e1-7599-4b96-a8d6-de516169c1eb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.156199 Jul 12 14:37:12.184507 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 247/527] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:12 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:13.202635 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:13.203243 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:13.209794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:13.210238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:13.211000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:13.211431 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:13.343925 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:13.351674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:13.353170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:13.354327 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-29821b5b-f089-4aee-8bd3-c839d713612b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.155617 Jul 12 14:37:13.354873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 281/528] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:13 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:14.161385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-73b6195d-d576-42f9-8a93-df953bbf1253 req-9532a3de-9db8-4996-9839-163e3e7d3964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "name": "network-vif-plugged", "status": "completed", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:14.171505 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-73b6195d-d576-42f9-8a93-df953bbf1253 req-9532a3de-9db8-4996-9839-163e3e7d3964 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.171947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-73b6195d-d576-42f9-8a93-df953bbf1253 req-9532a3de-9db8-4996-9839-163e3e7d3964 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.182079 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:14.183096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:14.190257 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.190706 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.191899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.192467 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.197597 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-73b6195d-d576-42f9-8a93-df953bbf1253 req-9532a3de-9db8-4996-9839-163e3e7d3964 service nova] Creating event network-vif-plugged:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:37:14.202454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-73b6195d-d576-42f9-8a93-df953bbf1253 req-9532a3de-9db8-4996-9839-163e3e7d3964 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045866 Jul 12 14:37:14.203420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 248/529] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:14.221175 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lazy-loading 'flavor' on Instance uuid 0fd4966f-fbaf-4a1e-b479-b56e448a0489 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:37:14.355435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c8a8b747-13e7-4fae-863e-69d570c22690 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/action" status: 200 len: 32 microversion: 2.1 time: 0.178175 Jul 12 14:37:14.356136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 282/530] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:37:14 2022] POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 14:37:14.367196 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:14.368145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:14.372907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:14.373891 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:14.376091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.376588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.377428 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.377899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.383545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.384544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.385372 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:14.385799 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:14.524239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:14.532943 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:14.534761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:14.535888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cf968d5e-b30c-4a1b-a328-c5edf687f229 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.167791 Jul 12 14:37:14.536489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 283/531] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:14 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:37:14.670498 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:14.678501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1251c0f9-9267-4437-b0ef-fc44ac7f8d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.316493 Jul 12 14:37:14.679075 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 249/532] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:14 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:15.554323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:15.554933 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:15.557499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:15.558190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:15.564831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:15.565279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:15.566076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:15.566519 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:15.693772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:15.695802 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:15.696414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:15.697157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:15.698483 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:15.702581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:15.704091 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:15.704624 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:15.705070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:15.705190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c7ceccf2-ee0d-4cd9-87b6-d044c3938553 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1407 microversion: 2.20 time: 0.154751 Jul 12 14:37:15.705768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 284/533] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:15 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:15.705898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:15.706278 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:15.887721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:15.895676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-370c9ced-195f-4854-8007-160122822223 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.203548 Jul 12 14:37:15.896172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 250/534] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:15 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:16.723488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:16.724129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:16.732198 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.732658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.733450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.733889 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.866166 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:16.874064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:16.875610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:16.876790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-839c36dc-f005-47b7-b778-c4322b1baa5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1598 microversion: 2.20 time: 0.157181 Jul 12 14:37:16.877367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 285/535] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:37:16 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:37:16.894470 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:16.894970 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:16.902122 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.902570 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.903327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.903761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.912030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:16.912637 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:16.918935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.919389 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.920157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:16.920599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:16.986516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bba83b49-162f-4648-86af-134af064af9d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095785 Jul 12 14:37:16.987201 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 251/536] 10.222.0.25 () {60 vars in 1315 bytes} [Tue Jul 12 14:37:16 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:37:17.055395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:17.064170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a65b829a-f0a2-49e3-9878-fb738589c7d6 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.155801 Jul 12 14:37:17.064746 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 286/537] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:16 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:17.595867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:17.596355 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:17.603777 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:17.604216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:17.604985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:17.605439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:17.628086 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-41b63bea-b06e-4b1b-a6a7-2f85719973f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/ips" status: 200 len: 149 microversion: 2.1 time: 0.036002 Jul 12 14:37:17.629185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 252/538] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:37:17 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:17.906682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-57ea39e6-9dab-4ad6-afba-e705aabacd6f req-6e4ed0e4-5cc7-4ea1-b7de-83062d392e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:17.918790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-57ea39e6-9dab-4ad6-afba-e705aabacd6f req-6e4ed0e4-5cc7-4ea1-b7de-83062d392e89 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:17.919398 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-57ea39e6-9dab-4ad6-afba-e705aabacd6f req-6e4ed0e4-5cc7-4ea1-b7de-83062d392e89 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:17.932264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-57ea39e6-9dab-4ad6-afba-e705aabacd6f req-6e4ed0e4-5cc7-4ea1-b7de-83062d392e89 service nova] Creating event network-changed:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:37:17.938229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-57ea39e6-9dab-4ad6-afba-e705aabacd6f req-6e4ed0e4-5cc7-4ea1-b7de-83062d392e89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036786 Jul 12 14:37:17.939316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 287/539] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:18.082391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:18.083539 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:18.095718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.096162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:18.097150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.097672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:18.312012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:18.320368 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-278c4ad9-e50b-4088-bc35-d140b83676cc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.242034 Jul 12 14:37:18.321048 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 253/540] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:18 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:18.960657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3e95ba9-f7fd-4551-aa05-339bab32d245"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:18.961750 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:18.967930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.968402 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:18.969159 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:18.969618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:19.222807 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c708e116-3aa3-44c8-a8c7-10bef3650596 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266733 Jul 12 14:37:19.223393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 288/541] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:37:18 2022] POST /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:19.338190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:19.338811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:19.345312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:19.345800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:19.346563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:19.347012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:19.350913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:19.477231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:19.485951 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7d6e5a66-6781-494f-b66d-df0d517d6790 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.152119 Jul 12 14:37:19.486521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 254/542] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:19 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:20.504631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:20.505325 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:20.511545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:20.511994 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:20.512893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:20.513342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:20.641443 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:20.649276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-74158779-a6ba-4a59-bf9f-7b4a29101bc3 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.149922 Jul 12 14:37:20.649861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 289/543] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:20 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:21.666752 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:21.667297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:21.673791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:21.674235 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:21.674994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:21.675422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:21.807271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:21.815910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-47350eb6-25f5-4fb3-8fb1-2cb0563e9cde tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.153626 Jul 12 14:37:21.816474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 255/544] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:21 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:22.834252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:22.834789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:22.841963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:22.842409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:22.843168 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:22.843599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:22.973198 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:22.981637 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebd41287-af1e-45a7-bcf9-e6a9ec379f91 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.151320 Jul 12 14:37:22.982194 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 290/545] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:22 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:23.997834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:23.998476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:24.005054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:24.005576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:24.006339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:24.006775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:24.136921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:24.145090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7bcf19d4-7a5e-4ced-91da-b749353fef22 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.151052 Jul 12 14:37:24.145688 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 256/546] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:23 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:25.162188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:25.162830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:25.169318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:25.169793 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:25.170555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:25.170987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:25.297638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:25.305516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-05aa931b-a454-4d1f-bf7f-7532e3ce8ae7 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.147167 Jul 12 14:37:25.306568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 291/547] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:25 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:26.323390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:26.324008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:26.326695 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:26.332814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.333322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.334375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.334810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.578810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:26.587500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f9bb5c78-9c25-48e6-944c-6beeb9d99f5a tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.267477 Jul 12 14:37:26.588116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 257/548] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:26 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:26.703219 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3e95ba9-f7fd-4551-aa05-339bab32d245"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:26.704333 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:26.706946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:26.712261 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.712710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.713513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.713959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.790629 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: POST /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments HTTP/1.1 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 74 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:37:26.792911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {"volumeAttachment": {"volumeId": "b3e95ba9-f7fd-4551-aa05-339bab32d245"}} Jul 12 14:37:26.794595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'server_id': '90d33678-1a9f-4331-8d26-8393eb80bcdf', 'body': {'volumeAttachment': {'volumeId': 'b3e95ba9-f7fd-4551-aa05-339bab32d245'}}} Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:26.795393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:26.796640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 400 to user: Invalid volume: volume b3e95ba9-f7fd-4551-aa05-339bab32d245 is already attached to instances: 90d33678-1a9f-4331-8d26-8393eb80bcdf {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5d5182a9-613e-4c4c-9840-779f234b4245 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095154 Jul 12 14:37:26.797860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 292/549] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:37:26 2022] POST /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:37:26.854510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:26.855007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:26.860977 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.861474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.862244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:26.862683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:26.944989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lazy-loading 'services' on Instance uuid 90d33678-1a9f-4331-8d26-8393eb80bcdf {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:37:27.016546 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d2db44cf-86e0-40ae-b6c5-1aafacf306c5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments/b3e95ba9-f7fd-4551-aa05-339bab32d245" status: 202 len: 0 microversion: 2.1 time: 0.166375 Jul 12 14:37:27.017323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 258/550] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:37:26 2022] DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments/b3e95ba9-f7fd-4551-aa05-339bab32d245 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:37:27.026019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:27.026981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:27.033053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:27.033538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:27.034296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:27.034729 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:27.067141 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0c7e2ae6-e091-47d6-a8b4-a1da70dc0f1f tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Jul 12 14:37:27.067705 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 293/551] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:37:27 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:27.604876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:27.605615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:27.611849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:27.612291 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:27.613047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:27.613516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:27.745595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:27.753810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a5405ac2-3ff2-4de8-867d-67f7bd6b0e3d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.153515 Jul 12 14:37:27.754372 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 259/552] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:27 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:28.079415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:28.080272 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:28.087066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:28.087658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:28.088436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:28.088876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:28.121666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-86e27089-beac-43fc-9a0c-13b7f73dfdea tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Jul 12 14:37:28.126698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 294/553] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:37:28 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:37:28.770839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:28.771382 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:28.778439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:28.778887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:28.779686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:28.780120 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:28.907293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:28.915218 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2f3302f9-9465-4c58-920c-c23871d65f07 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.148293 Jul 12 14:37:28.915778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 260/554] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:28 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:29.190349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:29.191365 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:29.197462 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.197909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.198669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.199105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.227275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b7588952-b7f4-40c1-b797-16f5f290d34b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097401 Jul 12 14:37:29.228449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 295/555] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:37:29 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:37:29.284477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:29.284974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:29.291058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.291524 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.292266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.292700 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.319378 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:37:29.393073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-19a93994-5454-4e35-a24e-adf77d20dac0 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 204 len: 0 microversion: 2.1 time: 0.111902 Jul 12 14:37:29.393609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 261/556] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:37:29 2022] DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:37:29.402055 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:29.402663 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:29.408685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.409133 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.409931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.410370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.541305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:29.548953 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-52dadfd6-6f96-4504-8ec7-ce17a8010ce5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1681 microversion: 2.1 time: 0.150820 Jul 12 14:37:29.549528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 296/557] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:29 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:29.932937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:29.933671 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:29.940317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.940754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:29.941534 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:29.941964 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:30.074166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:30.082082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8b08f499-411a-4de2-98de-b30cd9b3d4a5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.153867 Jul 12 14:37:30.082656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 262/558] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:29 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:30.567070 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:30.567693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:30.574414 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:30.574853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:30.575739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:30.576167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:30.706150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:30.713575 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fb9173e0-47a1-427d-a3ce-5e4acd65f561 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1681 microversion: 2.1 time: 0.150610 Jul 12 14:37:30.714133 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 297/559] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:30 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:31.099785 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:31.100394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:31.107437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.107881 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.108633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.109064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.298647 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:31.306642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e3523ef9-4f20-4a35-952e-6bdcf4f3c18b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.210760 Jul 12 14:37:31.307220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 263/560] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:31 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:31.730547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:31.731274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:31.737814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.738269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.739047 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:31.739482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:31.924818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:31.932568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6c80d8b0-a904-47b1-a48b-4a2519d13e64 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1681 microversion: 2.1 time: 0.205817 Jul 12 14:37:31.933064 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 298/561] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:31 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:32.312855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-0804f36f-c1b4-418d-a2a3-f9c2ad57ee85 req-b1785c5f-b06b-40ae-8ce0-8b44b447a1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d33678-1a9f-4331-8d26-8393eb80bcdf", "name": "network-vif-deleted", "tag": "0137cf9d-0533-4bde-8468-52e3982d7b08"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:32.322078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-0804f36f-c1b4-418d-a2a3-f9c2ad57ee85 req-b1785c5f-b06b-40ae-8ce0-8b44b447a1c9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:32.322601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-0804f36f-c1b4-418d-a2a3-f9c2ad57ee85 req-b1785c5f-b06b-40ae-8ce0-8b44b447a1c9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:32.324523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:32.325821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:32.332183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:32.332642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:32.333602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:32.334179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:32.335599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-0804f36f-c1b4-418d-a2a3-f9c2ad57ee85 req-b1785c5f-b06b-40ae-8ce0-8b44b447a1c9 service nova] Creating event network-vif-deleted:0137cf9d-0533-4bde-8468-52e3982d7b08 for instance 90d33678-1a9f-4331-8d26-8393eb80bcdf on hv-cinder-83699 Jul 12 14:37:32.341062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-0804f36f-c1b4-418d-a2a3-f9c2ad57ee85 req-b1785c5f-b06b-40ae-8ce0-8b44b447a1c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032140 Jul 12 14:37:32.341867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 264/562] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:32.483434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:32.491630 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1979e3dc-7c37-471b-a745-d398b1edd9c5 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.171563 Jul 12 14:37:32.492211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 299/563] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:32 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:32.950137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:32.950839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:32.957056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:32.957549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:32.958318 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:32.958751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:33.052847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:33.060578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6817e78f-bf1a-4148-a4ff-6dec355d40b5 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 200 len: 1326 microversion: 2.1 time: 0.114907 Jul 12 14:37:33.065604 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 265/564] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:32 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:33.510082 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:33.511166 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:33.518040 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:33.518491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:33.519264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:33.519705 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:33.651863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:33.655356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:33.660788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-78e5f225-7eca-49e7-82e9-4d5bf7e1c2f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.156226 Jul 12 14:37:33.661353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 300/565] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:33 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:34.078387 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:34.078905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:34.085355 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:34.085812 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:34.086567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:34.087712 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:34.101015 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf HTTP/1.1 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:37:34.104257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:37:34.105936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '90d33678-1a9f-4331-8d26-8393eb80bcdf'} Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:37:34.107244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:37:34.108765 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:37:34.110090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:37:34.110090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6b83d3a0-72e7-4a15-989f-d69af8425b11 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 404 len: 111 microversion: 2.1 time: 0.031709 Jul 12 14:37:34.110090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 266/566] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:34 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:37:34.114963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-af2adf6f-d859-4927-9fcf-e6230fb479ac tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '.version_select at 0x7f01caa8e820>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:34.133020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-af2adf6f-d859-4927-9fcf-e6230fb479ac tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753911916" status: 202 len: 0 microversion: 2.1 time: 0.021820 Jul 12 14:37:34.134182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 301/567] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 14:37:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753911916 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:37:34.678996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:34.679312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:34.686229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:34.686963 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:34.687738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:34.688214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:34.764446 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a4abfcfd-d354-4363-a8e8-ff5fb45b1e9a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: .version_select at 0x7f01caa64550>, body: {"keypair": {"name": "tempest-keypair-1729341348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMQIM6XbrObKsrdqgx1fo6dzp5H9YG2Tipij37astTnMKbfCJXZYWtXUWBW4vOqN8U6HEBH9EIRa5XmnSf68nHJvfBW6AnHULCbbEqKUOUZ8L5PobR+FsZR+s08aC+mLg=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:34.778692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-a4abfcfd-d354-4363-a8e8-ff5fb45b1e9a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:37:34.784934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-a4abfcfd-d354-4363-a8e8-ff5fb45b1e9a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:37:34.809788 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a4abfcfd-d354-4363-a8e8-ff5fb45b1e9a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049662 Jul 12 14:37:34.810394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 302/568] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:37:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:37:34.830673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:34.839339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2202f848-80b8-411c-a192-10f1a005c5f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1733 microversion: 2.1 time: 0.164743 Jul 12 14:37:34.839884 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 267/569] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:34 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:35.856549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:35.857160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:35.863135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:35.863582 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:35.864360 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:35.864795 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.057139 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:36.065506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-daec28ab-30ea-4bfe-92ce-4bf7fedecd0b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1713 microversion: 2.1 time: 0.213305 Jul 12 14:37:36.066059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 303/570] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:35 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1713 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:36.077966 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-143946544", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d70325-149a-4db6-bab3-e97d17656939"}], "security_groups": [{"name": "tempest-securitygroup--970869907"}], "key_name": "tempest-keypair-1729341348", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:36.120328 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:36.120827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:36.126852 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.127639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.128477 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.128917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.182604 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] validate_networks() for [('81d70325-149a-4db6-bab3-e97d17656939', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:37:36.252129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] HTTP exception thrown: Cannot 'detach_volume' instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 while it is in vm_state rescued Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Request method failure captured: Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments/aaa6889b-f822-471d-940b-02dbc1a49239 HTTP/1.1 Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYZctuhuOnn0F060zgZShYesLmWYTZb3V91v33sZDj3CCEn2j51pNFdFnHRdkvf8-nod7Vidl-6iGgdytrdKIn7NQg_FQ77pQ48XRRrNbUJwj3Td3qevlP9zx9PQLp4PudE0Iz3dndnEUYz82HZ3JgD9CvDqLZ-z6c8bzgPEYC9J1Cg Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:37:36.254095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_926f1338d73b48aebc0431e2121a0dba", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: a48066ed22e14c64a316fe4d66394f44 Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:37:36.255682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Cannot 'detach_volume' instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 while it is in vm_state rescued Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'server_id': '0fd4966f-fbaf-4a1e-b479-b56e448a0489', 'id': 'aaa6889b-f822-471d-940b-02dbc1a49239'} Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:37:36.256381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 while it is in vm_state rescued Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 while it is in vm_state rescued Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:37:36.257806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Returning 409 to user: Cannot 'detach_volume' instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 while it is in vm_state rescued {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:37:36.259491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7787483a-8c37-45fb-8673-54e8766f2b10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments/aaa6889b-f822-471d-940b-02dbc1a49239" status: 409 len: 152 microversion: 2.1 time: 0.139919 Jul 12 14:37:36.259491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 304/571] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:37:36 2022] DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments/aaa6889b-f822-471d-940b-02dbc1a49239 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 14:37:36.264685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:36.265236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:36.271604 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.272055 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.272830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.273271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.340135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ae644f60-3fe4-4d97-b5f1-2878a92e0a50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/action" status: 202 len: 0 microversion: 2.1 time: 0.078948 Jul 12 14:37:36.343855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 305/572] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:37:36 2022] POST /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:37:36.349130 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:36.349957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:36.357099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.357590 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.358745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.358956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.495096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:36.503672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-27d3a0aa-513c-41d9-81d2-5f7e8c36c8a8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1721 microversion: 2.1 time: 0.158445 Jul 12 14:37:36.504326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 306/573] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:36 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:36.677950 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:37:36.678375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:37:36.679500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:37:36.679989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:37:36.681076 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:37:36.690442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.690885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.691825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:36.692260 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:36.717622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:37:36.721575 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Getting quotas for user b22129ca8c714db6ad44dee94e6099e9 and project eb73ce3627964df4a085d7d9a81a9f59. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:37:36.733272 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:37:36.735652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:37:36.789377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-47079353-c559-48d3-aa03-c3cc1ef86a85 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715221 Jul 12 14:37:36.795088 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 268/574] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:37:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:37:36.800267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ca352d3d-399f-4a15-a21a-f395ad5d09e6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:36.800999 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ca352d3d-399f-4a15-a21a-f395ad5d09e6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:36.856872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ca352d3d-399f-4a15-a21a-f395ad5d09e6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:36.864340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ca352d3d-399f-4a15-a21a-f395ad5d09e6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1241 microversion: 2.1 time: 0.067899 Jul 12 14:37:36.864982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 307/575] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:36 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:37.521128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:37.521723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:37.528762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:37.529210 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:37.530032 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:37.530466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:37.657631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:37.666078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ecd72e51-e255-4174-9bd2-36df3d6e35e1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1721 microversion: 2.1 time: 0.148903 Jul 12 14:37:37.666641 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 269/576] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:37 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:37.881034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:37.881674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:37.888771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:37.889220 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:37.890010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:37.890447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:37.954300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:37.962117 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e262c4e4-c83f-4122-a539-c88bc646af48 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1237 microversion: 2.1 time: 0.084475 Jul 12 14:37:37.962671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 308/577] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:37 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:38.684673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:38.685190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:38.691909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:38.692379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:38.693159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:38.693633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:38.712790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:38.827330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:38.835366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a1727c53-d237-4ca4-b27e-98c74508eb10 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1721 microversion: 2.1 time: 0.155147 Jul 12 14:37:38.835916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 270/578] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:38 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:38.979551 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:38.980090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:38.986598 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:38.987042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:38.987799 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:38.988233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:39.048176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:39.055545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-10400705-c8e4-428b-a97d-ac8a64817b41 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1293 microversion: 2.1 time: 0.080522 Jul 12 14:37:39.056098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 309/579] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:38 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:39.853548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:39.854166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:39.860650 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:39.861102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:39.861914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:39.863364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:39.990828 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:39.999264 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e57c1b2a-ae9c-4d0a-9a4d-d5858884e483 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1727 microversion: 2.1 time: 0.150193 Jul 12 14:37:39.999827 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 271/580] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:39 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:40.015692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:40.016211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:40.022709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:40.023160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:40.023924 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:40.024359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:40.072453 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:40.073902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:40.080737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:40.080737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:40.081356 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:40.081822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:40.104659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-57f5fc2b-71fb-4a34-9019-2653b968019b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092782 Jul 12 14:37:40.109757 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 310/581] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:37:40 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:40.216715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:40.224324 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e28e303c-64bd-449d-90ca-03429f320d49 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1301 microversion: 2.1 time: 0.155982 Jul 12 14:37:40.225220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 272/582] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:40 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1301 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:41.244790 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:41.245462 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:41.252107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:41.252560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:41.253356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:41.253809 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:41.318354 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:41.326571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-20dba5d4-cfce-4bcf-8e8b-52f7f6dce781 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1299 microversion: 2.1 time: 0.088142 Jul 12 14:37:41.327065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 311/583] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:41 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:41.828661 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-9a8eb923-d131-4ef8-ae8f-172ccfeaf8a8 req-f2b0fd94-7718-4e36-83ee-dfa773045eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:41.839450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-9a8eb923-d131-4ef8-ae8f-172ccfeaf8a8 req-f2b0fd94-7718-4e36-83ee-dfa773045eb1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:41.839889 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-9a8eb923-d131-4ef8-ae8f-172ccfeaf8a8 req-f2b0fd94-7718-4e36-83ee-dfa773045eb1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:41.858460 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-9a8eb923-d131-4ef8-ae8f-172ccfeaf8a8 req-f2b0fd94-7718-4e36-83ee-dfa773045eb1 service nova] Creating event network-changed:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:37:41.864803 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-9a8eb923-d131-4ef8-ae8f-172ccfeaf8a8 req-f2b0fd94-7718-4e36-83ee-dfa773045eb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039627 Jul 12 14:37:41.865677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 273/584] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:42.343679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:42.344521 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:42.351389 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:42.351920 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:42.353326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:42.353853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:42.500761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:42.508178 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b81d069a-2abf-4370-ae0e-e00596262844 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.168333 Jul 12 14:37:42.517828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 312/585] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:42 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:43.524697 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:43.525319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:43.532094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:43.532544 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:43.533307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:43.533770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:43.664043 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:43.672013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-53efd349-b3cb-4499-97b9-4bf56fda02c2 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.151623 Jul 12 14:37:43.672575 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 274/586] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:43 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:43.879994 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}, {"name": "network-changed", "server_uuid": "eb2e928a-5e26-4720-ac84-a3d5d46ae967", "tag": "1f56d104-48b0-4f02-a8f2-28aec80164bf"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:43.889382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:43.889829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:43.902785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] Creating event network-changed:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:37:43.903296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] Creating event network-changed:1f56d104-48b0-4f02-a8f2-28aec80164bf for instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 on hv-cinder-83699 Jul 12 14:37:43.909647 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-11a6c8e9-62a9-4530-a0ca-e8741d40e48e req-51c291c7-94ae-4733-9106-a37bb4ebb649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033288 Jul 12 14:37:43.910205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 313/587] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:44.689516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:44.690293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:44.698538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:44.699022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:44.699879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:44.700317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:44.919583 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:44.927027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-56d8f302-fe97-417e-b552-97c6e8270ab8 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.241682 Jul 12 14:37:44.927627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 275/588] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:44 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:45.945591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:45.946293 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:45.952673 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:45.953073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:45.953932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:45.954297 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:46.081137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:46.088524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e6ee9591-3108-4b8a-92e8-c51e699f60dd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.147675 Jul 12 14:37:46.089084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 314/589] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:45 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:47.105938 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:47.106552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:47.109033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:47.109747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:47.115706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:47.116138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:47.116902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:47.117363 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:47.245520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:47.253513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-db01c420-3f76-4d20-8dd1-12b8c32aabb4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.151922 Jul 12 14:37:47.254077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 276/590] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:47 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:48.270247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:48.270945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:48.273140 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:48.279499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:48.279939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:48.280699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:48.281126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:48.346755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-f32636a4-ec47-4826-9a1b-1d8e0a393bb5 req-650b912f-0a49-4a93-9f1b-ad6faa701991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2e928a-5e26-4720-ac84-a3d5d46ae967", "name": "network-vif-plugged", "status": "completed", "tag": "1f56d104-48b0-4f02-a8f2-28aec80164bf"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:48.355900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-f32636a4-ec47-4826-9a1b-1d8e0a393bb5 req-650b912f-0a49-4a93-9f1b-ad6faa701991 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:48.356496 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-f32636a4-ec47-4826-9a1b-1d8e0a393bb5 req-650b912f-0a49-4a93-9f1b-ad6faa701991 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:48.370941 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-f32636a4-ec47-4826-9a1b-1d8e0a393bb5 req-650b912f-0a49-4a93-9f1b-ad6faa701991 service nova] Creating event network-vif-plugged:1f56d104-48b0-4f02-a8f2-28aec80164bf for instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 on hv-cinder-83699 Jul 12 14:37:48.377254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-f32636a4-ec47-4826-9a1b-1d8e0a393bb5 req-650b912f-0a49-4a93-9f1b-ad6faa701991 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033618 Jul 12 14:37:48.377840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 277/591] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:48.416959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:48.424606 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9f4708d4-6bd9-4d8a-83d1-2180875d137e tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.158199 Jul 12 14:37:48.425175 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 315/592] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:48 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:49.442249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:49.442957 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:49.449783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:49.450233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:49.450999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:49.451436 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:49.579893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:49.587833 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c8ad7374-ca23-4d07-86ea-e9722cbcd410 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.149806 Jul 12 14:37:49.588389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 278/593] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:49 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:50.603982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:50.604586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:50.611069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:50.611509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:50.612260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:50.612688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:50.738499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:50.746638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5ecfab92-8433-4857-bc4f-18d4b4501730 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1366 microversion: 2.1 time: 0.146472 Jul 12 14:37:50.747195 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 316/594] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:50 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:51.093987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:51.094528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:51.100970 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.101447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.102216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.102654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.124159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lazy-loading 'flavor' on Instance uuid 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:37:51.194003 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-72efd10f-1494-4eed-a51d-90854c5b1d0a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "POST /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4/action" status: 202 len: 0 microversion: 2.1 time: 0.103744 Jul 12 14:37:51.194609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 279/595] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:37:51 2022] POST /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:37:51.203405 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:51.204054 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:51.210970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.212287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.213866 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.214308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.345819 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:51.354056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f05058bb-0a44-4427-9a37-c42f5df5d0c8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.154540 Jul 12 14:37:51.354615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 317/596] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:51 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:51.764010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:51.764640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:51.771060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.771514 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.772283 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.772722 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.905659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:51.913065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4819a5ba-f474-4e6b-99de-0c277be5cb40 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1555 microversion: 2.1 time: 0.153444 Jul 12 14:37:51.913665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 280/597] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:51 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:51.929608 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:51.930692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:51.937384 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.937829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:51.938584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:51.939016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:52.014663 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-99d28598-5dc8-44af-8468-cef1b8ece2bd tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088765 Jul 12 14:37:52.015184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 318/598] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:37:51 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:52.372404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:52.373004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:52.380058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:52.380512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:52.381295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:52.381775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:52.529493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:52.537359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5cbe807d-a1cb-4f1f-b1e8-0b2968f65db2 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.168859 Jul 12 14:37:52.537936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 281/599] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:52 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:53.196679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-d24bea08-63b6-46c1-902a-a9755e65d8d2 req-1a43a7ff-1049-4c41-b18b-3f73b2a48856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb2e928a-5e26-4720-ac84-a3d5d46ae967", "tag": "1f56d104-48b0-4f02-a8f2-28aec80164bf"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:53.204726 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d24bea08-63b6-46c1-902a-a9755e65d8d2 req-1a43a7ff-1049-4c41-b18b-3f73b2a48856 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:53.205160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-d24bea08-63b6-46c1-902a-a9755e65d8d2 req-1a43a7ff-1049-4c41-b18b-3f73b2a48856 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:53.217448 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-d24bea08-63b6-46c1-902a-a9755e65d8d2 req-1a43a7ff-1049-4c41-b18b-3f73b2a48856 service nova] Creating event network-changed:1f56d104-48b0-4f02-a8f2-28aec80164bf for instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 on hv-cinder-83699 Jul 12 14:37:53.222751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-d24bea08-63b6-46c1-902a-a9755e65d8d2 req-1a43a7ff-1049-4c41-b18b-3f73b2a48856 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090124 Jul 12 14:37:53.223386 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 319/600] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:37:53.555014 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:53.555774 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:53.563079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:53.563794 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:53.564666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:53.565248 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:53.781054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:53.788771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-05dbfc91-6453-41b0-8271-162c5a452816 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.237663 Jul 12 14:37:53.794675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 282/601] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:53 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:54.672948 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:54.673677 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:54.679841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.680773 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.681557 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.681986 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.706365 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:37:54.731227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:54.778730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-471c27e0-8128-4839-b392-7933988956cc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 204 len: 0 microversion: 2.1 time: 0.110180 Jul 12 14:37:54.779316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 320/602] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:37:54 2022] DELETE /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:37:54.788981 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:54.789640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:54.796303 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.796755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.797569 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.798041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.806883 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:54.807575 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:54.813725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.814172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.814926 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:54.815353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:54.940004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:54.947946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d8bfd0c4-d86d-40f4-821b-4841919d0cbc tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1575 microversion: 2.1 time: 0.164119 Jul 12 14:37:54.948922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 283/603] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:54 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:54.952906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:54.960372 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d957a884-db15-4d45-8ad1-235cd32d69b0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.158324 Jul 12 14:37:54.960916 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 321/604] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:54 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:55.966471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:55.967115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:55.973711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:55.974153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:55.974915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:55.975345 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:55.977674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:55.978385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:55.984748 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:55.985199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:55.986429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:55.986429 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:56.112761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:56.118899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:56.121112 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-743214eb-4b1d-4ca3-9bcb-f759d2427466 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1575 microversion: 2.1 time: 0.158603 Jul 12 14:37:56.121807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 284/605] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:55 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:56.126952 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c757a58e-1ee5-4fb3-8736-3dda3ab83538 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.153608 Jul 12 14:37:56.127613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 322/606] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:55 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:57.137739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:57.138360 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:57.140719 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:57.144707 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:57.145307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:57.145953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:57.146412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:57.147189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:57.147288 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:57.147629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:57.152973 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:57.153482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:57.154280 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:57.154757 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:57.283864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:57.291612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ab56ad8e-1821-4d11-854f-1126f8246e67 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1575 microversion: 2.1 time: 0.157786 Jul 12 14:37:57.292186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 285/607] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:57 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:57.294763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:57.302189 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dbe238b7-de9d-4967-aca2-e6f9e679ef47 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.161716 Jul 12 14:37:57.302771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 323/608] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:57 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:58.308586 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:58.309376 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:58.319392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:58.322813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:58.325455 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:58.325937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:58.326738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:58.327175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:58.334759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:58.335605 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:58.337950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:58.339107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:58.347119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:58.402035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:58.412940 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e5afcc19-0b52-414b-b538-784355f38d4d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1508 microversion: 2.1 time: 0.108688 Jul 12 14:37:58.413708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 286/609] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:58 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1508 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:58.490827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:58.498435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0181280a-7efb-4ff1-82fa-b2bd8c003642 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.183921 Jul 12 14:37:58.498998 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 324/610] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:58 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:37:58.691317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-c03a59b2-f08f-4403-9173-504bb7fc7cfc req-1644448e-62bd-4c33-aeaf-561e4db3b931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82caa470-858f-4885-aff4-ee0bbea62417", "name": "network-vif-deleted", "tag": "85b044af-a540-4ed9-bcac-01e0d29b4bb4"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:37:58.701205 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c03a59b2-f08f-4403-9173-504bb7fc7cfc req-1644448e-62bd-4c33-aeaf-561e4db3b931 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:58.701820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c03a59b2-f08f-4403-9173-504bb7fc7cfc req-1644448e-62bd-4c33-aeaf-561e4db3b931 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:58.716408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-c03a59b2-f08f-4403-9173-504bb7fc7cfc req-1644448e-62bd-4c33-aeaf-561e4db3b931 service nova] Creating event network-vif-deleted:85b044af-a540-4ed9-bcac-01e0d29b4bb4 for instance 82caa470-858f-4885-aff4-ee0bbea62417 on hv-cinder-83699 Jul 12 14:37:58.724682 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-c03a59b2-f08f-4403-9173-504bb7fc7cfc req-1644448e-62bd-4c33-aeaf-561e4db3b931 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102201 Jul 12 14:37:58.725927 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 287/611] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:37:59.429930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:59.431072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:59.438006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:59.438489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:59.439289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:59.439720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:59.470060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:59.470461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:59.470910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lazy-loading 'fault' on Instance uuid 82caa470-858f-4885-aff4-ee0bbea62417 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:37:59.513058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:59.516116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:37:59.516921 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:37:59.521055 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4ec870b8-8af3-4037-aa61-837d64b74060 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 200 len: 1229 microversion: 2.1 time: 0.094953 Jul 12 14:37:59.521656 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 325/612] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:59 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:37:59.530479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:59.530479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:59.530479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:37:59.530479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:37:59.671591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:37:59.680620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-23c34905-8ef9-4233-bb9d-0f2522ce9b56 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.168333 Jul 12 14:37:59.681459 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 288/613] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:37:59 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:00.538513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:00.539155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:00.546295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:00.546741 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:00.547505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:00.547941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:00.560843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] HTTP exception thrown: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Request method failure captured: Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 HTTP/1.1 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYZ0cS-Kp42Co_vYPLUf7knWNAYoqaZ4cY2PF5dAW9XCYRTpAGds_KtJwfrXARDxaV-yDRYlGmiSjfEDREqz2Rf6_IEYXbRUzoaqrentRu_68WNmkkTFpYpyTmBnCEoWgE5aCKH36VWxRx3rFq0fgAHa_nIF9tMaUzvVcjKBAyPt8jc Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:38:00.562737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aac705367c454623a23f11bfa8d25756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aac705367c454623a23f11bfa8d25756", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 42165c1e1b324fedbb926ac20f0f920a Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:38:00.564368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '82caa470-858f-4885-aff4-ee0bbea62417'} Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:38:00.565469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:38:00.566977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:00.568367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Returning 404 to user: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:38:00.568367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2e6c9638-8494-49c1-b83c-b5f14884d600 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 404 len: 111 microversion: 2.1 time: 0.029510 Jul 12 14:38:00.568367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 326/614] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:00 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:38:00.698407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:00.699018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:00.705493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:00.705950 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:00.706776 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:00.707205 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:00.711796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1637741859", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1989063543", "security_groups": [{"name": "tempest-secgroup-smoke-943141086"}], "block_device_mapping_v2": [{"uuid": "da8d1431-01a6-47cb-b91e-44e26ef5238d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6738aee6-ace2-4e59-b649-77430daecb40"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:00.830492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] validate_networks() for [('6738aee6-ace2-4e59-b649-77430daecb40', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:38:00.842500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:00.850245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ea0df953-bfed-4a29-85f9-9f4be5a835a3 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.155627 Jul 12 14:38:00.850821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 289/615] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:00 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:01.231667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:38:01.232085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:38:01.232549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:38:01.232948 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:38:01.233387 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:38:01.242153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.243154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:01.243949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.244426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:01.261098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:38:01.265013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for user 42165c1e1b324fedbb926ac20f0f920a and project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:38:01.321394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:38:01.323481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da8d1431-01a6-47cb-b91e-44e26ef5238d',volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:38:01.445846 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-99a77acb-20bc-437a-9cdf-cc3dce13da6b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738390 Jul 12 14:38:01.446484 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 327/616] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:38:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 14:38:01.456481 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9c72296a-8bc4-4275-b2f1-58028291d631 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:01.457107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9c72296a-8bc4-4275-b2f1-58028291d631 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:01.512717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9c72296a-8bc4-4275-b2f1-58028291d631 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:01.519393 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9c72296a-8bc4-4275-b2f1-58028291d631 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1095 microversion: 2.1 time: 0.066817 Jul 12 14:38:01.519951 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 290/617] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:01 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:01.764124 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:01.764686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:01.771357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.771899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:01.772724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.773221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:01.796406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-45a57625-4812-489a-b39b-269094a15280 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/ips" status: 200 len: 151 microversion: 2.20 time: 0.088265 Jul 12 14:38:01.797236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 328/618] 10.222.0.25 () {60 vars in 1288 bytes} [Tue Jul 12 14:38:01 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:38:01.867404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:01.868061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:01.875328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.875677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:01.876706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:01.877281 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:02.044849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:02.054605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fb053049-e8b9-4ee2-81fe-2eb9e6087128 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.191084 Jul 12 14:38:02.056422 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 291/619] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:01 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:02.536718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:02.537283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:02.543777 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:02.544225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:02.544985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:02.545461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:02.606960 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:02.614313 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7e7aa2bf-eac8-40e0-b783-b204b2f6f09f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1193 microversion: 2.1 time: 0.081606 Jul 12 14:38:02.614870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 329/620] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:02 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:03.073512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:03.074028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:03.080544 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:03.080997 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:03.081802 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:03.082241 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:03.289127 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:03.296753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-217cab25-8596-4478-83d2-51eb30f0e81c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.227902 Jul 12 14:38:03.297340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 292/621] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:03 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:03.631623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:03.632229 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:03.640865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:03.641318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:03.642255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:03.642692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:03.812645 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:03.820472 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-67b7b224-dd16-4c38-90b4-7ce301f49821 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1278 microversion: 2.1 time: 0.192664 Jul 12 14:38:03.821325 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 330/622] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:03 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:04.107886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:04.109192 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:04.115862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.116323 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.117093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.117631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.142681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lazy-loading 'flavor' on Instance uuid c3cba68e-29aa-4287-ad43-50abd844dd13 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:38:04.315523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:04.316118 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:04.324228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.326186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.327267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.327907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.451369 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-030358d4-0593-4ec9-b871-c3b1d31a836e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/action" status: 202 len: 0 microversion: 2.20 time: 0.347196 Jul 12 14:38:04.452427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 293/623] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 14:38:04 2022] POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:38:04.458534 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-d521f7db-d11e-48fb-a131-d00f5695fc67 req-c5a501fa-4595-4dbe-a26b-5024423452be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79871b04-6603-485a-82e7-bbcd6dbf65dd", "tag": "234c364b-ee17-4a48-a122-11e6ffb25c40"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:04.485798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d521f7db-d11e-48fb-a131-d00f5695fc67 req-c5a501fa-4595-4dbe-a26b-5024423452be service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.489952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d521f7db-d11e-48fb-a131-d00f5695fc67 req-c5a501fa-4595-4dbe-a26b-5024423452be service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.506719 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-d521f7db-d11e-48fb-a131-d00f5695fc67 req-c5a501fa-4595-4dbe-a26b-5024423452be service nova] Creating event network-changed:234c364b-ee17-4a48-a122-11e6ffb25c40 for instance 79871b04-6603-485a-82e7-bbcd6dbf65dd on hv-cinder-83699 Jul 12 14:38:04.513229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-d521f7db-d11e-48fb-a131-d00f5695fc67 req-c5a501fa-4595-4dbe-a26b-5024423452be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059366 Jul 12 14:38:04.513914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 294/624] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:04.519351 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:04.521723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:04.529458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.529965 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.530959 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.531405 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.535031 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:04.544325 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ff53deec-04a6-4a87-b46a-255877f711fe tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.233442 Jul 12 14:38:04.545525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 331/625] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:04 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:04.672075 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:04.680687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:04.682344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:04.683535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2471f304-6d34-4d41-95a2-e2faa89fe575 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.168344 Jul 12 14:38:04.684087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 295/626] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:04 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:04.838696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:04.839309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:04.845866 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.846305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.847069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:04.847502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:04.978919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:04.986623 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-04825009-155b-4329-8575-eb7b0554d825 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.152381 Jul 12 14:38:04.987343 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 332/627] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:04 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:05.562243 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:05.562891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:05.569487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:05.569946 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:05.571203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:05.571639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:05.702443 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:05.703073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:05.709001 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:05.709478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:05.710250 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:05.710688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:05.746919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:05.754826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4a04d7b8-25ac-4d13-bc2d-8fd92367424a tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.196724 Jul 12 14:38:05.755400 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 296/628] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:05 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:05.840543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:05.848854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:05.850376 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:05.851554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8b0eae82-ebae-474d-b275-141cb1235b70 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.152964 Jul 12 14:38:05.852100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 333/629] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:05 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:06.004741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:06.005297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:06.011912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.012359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.013124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.013587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.209942 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:06.217571 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-995e9524-fdac-4fd7-b808-944cb89abeb5 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.216682 Jul 12 14:38:06.218128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 297/630] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:05 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:06.772458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:06.773155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:06.779864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.780396 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.781090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.781658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.870715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:06.871338 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:06.878104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.878795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.879576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:06.880018 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:06.919591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:06.927532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-816591a2-a7fc-45de-80aa-5b0a95a84354 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.159291 Jul 12 14:38:06.928088 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 334/631] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:06 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:07.087410 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:07.095688 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:07.097217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:07.098432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-65679260-8c5d-49e6-b423-b9a10f2a787a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.232163 Jul 12 14:38:07.098987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 298/632] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:06 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:07.233968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:07.234505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:07.240562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:07.241114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:07.242656 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:07.243172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:07.371500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:07.379025 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b8d2026c-0a4b-4a8a-92e8-1cc4bd0fb8c2 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.149002 Jul 12 14:38:07.379584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 335/633] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:07 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:07.945261 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:07.945896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:07.952411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:07.952851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:07.953663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:07.954097 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:08.083982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:08.093180 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c95ffeab-98b6-4d1b-833f-24021729a734 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.151763 Jul 12 14:38:08.093776 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 299/634] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:07 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:08.115856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:08.116461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:08.123212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:08.123702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:08.124500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:08.124976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:08.254333 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:08.262801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:08.264339 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:08.265544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-28f0af6d-063c-4bb6-a98e-6a5d398e5370 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.153530 Jul 12 14:38:08.266098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 336/635] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:08 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:08.395838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:08.396480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:08.402689 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:08.403130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:08.403893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:08.404326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:08.532623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:08.540064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-138044bb-8580-479e-958c-ec1a480d0b30 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.148082 Jul 12 14:38:08.540620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 300/636] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:08 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:09.111532 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:09.112145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:09.118222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.118782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.119414 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.119849 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.248678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:09.252091 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:09.256889 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-436b5e67-ce9f-4266-a16f-9258b3a017fc tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.149369 Jul 12 14:38:09.257474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 337/637] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:09 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:09.283411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:09.284016 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:09.290445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.290887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.291637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.292068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.423029 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:09.431442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:09.432879 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:09.434062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a7c66dcc-59bb-416f-b49d-8dc49ccc1e4f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.154496 Jul 12 14:38:09.434614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 301/638] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:09 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:09.558682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:09.559303 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:09.566946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.567397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.568169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:09.568611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:09.700340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:09.707813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c308ef90-5f35-4c44-b28d-be91f69c2da1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.154351 Jul 12 14:38:09.708373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 338/639] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:09 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:10.273602 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:10.274218 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:10.280279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.280731 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.281526 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.281964 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.412648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.420509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-db78e906-48af-4975-85a8-eaad363ce155 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1571 microversion: 2.1 time: 0.150819 Jul 12 14:38:10.421114 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 302/640] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:10 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:10.437425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:10.438000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:10.444625 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.445071 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.446445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.446882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.452727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:10.453365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:10.459533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.459979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.460748 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.461312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.479836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:10.546639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ed84a829-4712-436d-b86c-52af37f7adf9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "POST /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4/action" status: 202 len: 0 microversion: 2.1 time: 0.113278 Jul 12 14:38:10.550144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 339/641] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:38:10 2022] POST /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:38:10.557468 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:10.558084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:10.564574 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.565121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.566037 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.566460 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.635493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.645093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.649666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.651085 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e9f6b7ce-0604-41ca-b756-25aeb842d070 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.202661 Jul 12 14:38:10.651978 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 303/642] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:10 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:10.706604 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.714262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-346f6347-4987-4947-99c3-6f495f8215de tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1519 microversion: 2.1 time: 0.161211 Jul 12 14:38:10.714834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 340/643] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:10 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:10.725146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:10.725873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:10.733183 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.733665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.734435 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:10.734867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:10.873249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:10.881358 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a4c64180-aff7-4e82-99a7-4c61f5429801 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.160204 Jul 12 14:38:10.890744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 304/644] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:10 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:11.670907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:11.671556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:11.673549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:11.674210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:11.681401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.681853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:11.682627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.683063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:11.732110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:11.732823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:11.735255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:11.741108 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.741601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:11.742389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.742854 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:11.821734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:11.830252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:11.831801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:11.833222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f2965cf4-25b8-444a-94b2-b4e4ea653c51 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.167003 Jul 12 14:38:11.833818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 341/645] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:11 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:11.894092 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:11.902537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:11.903190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:11.909800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cc38d4ca-ce27-4c18-8a32-e08ba67fb425 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1521 microversion: 2.1 time: 0.181422 Jul 12 14:38:11.910386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 305/646] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:11 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:11.917841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.918294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:11.919069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:11.919705 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.051834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:12.059355 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-723cd78a-cc77-46f3-a7b8-520f190849c1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.161625 Jul 12 14:38:12.059919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 342/647] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:11 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:12.566172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-9b50d72b-ada5-4252-bb97-72261854f285 req-9f638517-9111-48a8-bad8-c823829d175e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "name": "network-vif-unplugged", "status": "completed", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:12.575607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-9b50d72b-ada5-4252-bb97-72261854f285 req-9f638517-9111-48a8-bad8-c823829d175e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:12.576663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-9b50d72b-ada5-4252-bb97-72261854f285 req-9f638517-9111-48a8-bad8-c823829d175e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.588384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.compute.server_external_events [req-9b50d72b-ada5-4252-bb97-72261854f285 req-9f638517-9111-48a8-bad8-c823829d175e service nova] Unable to find a host for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4. Dropping event network-vif-unplugged {{(pid=124549) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 14:38:12.589278 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-9b50d72b-ada5-4252-bb97-72261854f285 req-9f638517-9111-48a8-bad8-c823829d175e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027536 Jul 12 14:38:12.589896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 306/648] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 14:38:12.852765 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:12.853316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:12.859762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:12.860211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.860976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:12.861440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.927064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:12.927683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:12.935157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:12.935612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.936392 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:12.937308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:12.991444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:13.000228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:13.001819 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:13.002990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5855706f-7026-421a-bab1-123d3be34a95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.154837 Jul 12 14:38:13.003552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 343/649] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:12 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:13.068785 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:13.077203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-92f8124e-59f1-4622-8ac9-6d575c43dc81 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.153908 Jul 12 14:38:13.077687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:13.077803 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 307/650] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:12 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:13.078307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:13.084242 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:13.084690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:13.085480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:13.085942 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:13.221502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:13.229648 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e786d556-9aca-403c-8d42-ff83df2f817a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.156983 Jul 12 14:38:13.230277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 344/651] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:13 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:14.021061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:14.021615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:14.028561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.029011 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.029817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.030255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.095005 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:14.095610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:14.102681 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.103121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.103880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.104309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.166835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:14.174789 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:14.176279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:14.177457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fbcda9d3-0c55-40d7-ab07-ccc236f73156 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.160396 Jul 12 14:38:14.178020 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 308/652] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:14 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:14.233293 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:14.240751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4332fb9b-270d-4d77-9fa1-1b562631c5bd tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.149775 Jul 12 14:38:14.241500 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 345/653] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:14 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:14.248052 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:14.248801 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:14.255062 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.255513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.256288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.256723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.390047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:14.397749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fe1cddb7-93c9-4816-bff9-90f04bfa4677 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.154363 Jul 12 14:38:14.407442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 309/654] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:14 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:14.603698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-fde449c0-ed87-4864-950a-7440f1714be3 req-3b633aa0-2e68-4643-ade2-c39d096322e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79871b04-6603-485a-82e7-bbcd6dbf65dd", "name": "network-vif-plugged", "status": "completed", "tag": "234c364b-ee17-4a48-a122-11e6ffb25c40"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:14.611964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-fde449c0-ed87-4864-950a-7440f1714be3 req-3b633aa0-2e68-4643-ade2-c39d096322e3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:14.612406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-fde449c0-ed87-4864-950a-7440f1714be3 req-3b633aa0-2e68-4643-ade2-c39d096322e3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:14.625363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-fde449c0-ed87-4864-950a-7440f1714be3 req-3b633aa0-2e68-4643-ade2-c39d096322e3 service nova] Creating event network-vif-plugged:234c364b-ee17-4a48-a122-11e6ffb25c40 for instance 79871b04-6603-485a-82e7-bbcd6dbf65dd on hv-cinder-83699 Jul 12 14:38:14.630165 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-fde449c0-ed87-4864-950a-7440f1714be3 req-3b633aa0-2e68-4643-ade2-c39d096322e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 Jul 12 14:38:14.630774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 346/655] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:15.195905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:15.196513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:15.203001 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.203444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.204210 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.204643 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.260273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:15.260954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:15.267225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.267675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.268542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.268982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.334100 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:15.342133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:15.343673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:15.344837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-78a9afd2-b51d-4267-bfbb-a9394d065910 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.152895 Jul 12 14:38:15.345419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 310/656] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:15 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:15.398436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:15.406138 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9cd53bdb-f006-4b80-9142-54063bdf7d6b tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.150646 Jul 12 14:38:15.406714 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 347/657] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:15 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:15.415497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:15.416171 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:15.422322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.422808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.423581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:15.424041 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:15.554680 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:15.562413 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5ceea53b-418f-4d0e-a976-866bee64accd tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.151026 Jul 12 14:38:15.562975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 311/658] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:15 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:16.363641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:16.364254 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:16.371663 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.372084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.372858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.373292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.423647 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:16.424260 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:16.431636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.432185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.433033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.433504 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.513002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:16.521903 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:16.523424 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:16.524594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d5651836-dbe9-47f4-bd64-f3e66cbc904d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.164913 Jul 12 14:38:16.525155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 348/659] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:16 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:16.576213 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:16.578331 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:16.578949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:16.583707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-12750bd7-40f7-4e69-b29c-51852a8cc439 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.163912 Jul 12 14:38:16.584267 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 312/660] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:16 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:16.585059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.585554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.586332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:16.586903 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:16.724199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:16.732191 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bc0c1c08-6f35-4fd5-a511-7e5dcbdc3195 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1266 microversion: 2.1 time: 0.157779 Jul 12 14:38:16.732761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 349/661] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:16 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:17.543141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:17.543755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:17.550265 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.550713 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.551481 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.551922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.600304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:17.601004 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:17.607665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.608174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.608939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.609385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.680843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:17.689191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:17.690820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:17.691975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5e3172dc-dd0a-44eb-a7f1-a4994ade2e20 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.153307 Jul 12 14:38:17.692531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 313/662] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:17 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:17.743371 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:17.748945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:17.749585 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:17.751038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f3cffb72-8eca-42c3-95c4-acf52bb74502 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.154591 Jul 12 14:38:17.751601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 350/663] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:17 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:17.755711 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.756154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.756912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.757356 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.888049 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:17.895587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2b45f556-8cb3-42ca-9870-537338478e1d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1453 microversion: 2.1 time: 0.150403 Jul 12 14:38:17.896143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 314/664] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:17 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:17.911780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:17.912400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:17.918351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.918797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:17.919590 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:17.920023 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:18.046782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:18.054173 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-beb295c2-568c-4df0-a90f-293b1d2547b1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1453 microversion: 2.1 time: 0.146157 Jul 12 14:38:18.055249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 351/665] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:17 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:18.709623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:18.710234 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:18.717277 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:18.717771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:18.718532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:18.718967 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:18.768308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:18.768908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:18.776155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:18.776599 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:18.777426 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:18.777867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:18.851815 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:18.860386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:18.861985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:18.863137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-56a76b53-127a-45cb-92ea-832365d974ce tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.157501 Jul 12 14:38:18.863690 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 315/666] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:18 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:18.985523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:18.993558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f7dece65-1a4f-4249-bccc-e14332416993 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.229490 Jul 12 14:38:18.994316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 352/667] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:18 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:19.882085 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:19.882764 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:19.890088 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:19.890088 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:19.890823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:19.891260 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:19.948262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b6c85c56-2ea3-4efd-a319-92959c4b3e57 req-d403f9ad-17b7-4239-b0c6-809ba1598096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79871b04-6603-485a-82e7-bbcd6dbf65dd", "tag": "234c364b-ee17-4a48-a122-11e6ffb25c40"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:19.957524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b6c85c56-2ea3-4efd-a319-92959c4b3e57 req-d403f9ad-17b7-4239-b0c6-809ba1598096 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:19.958056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b6c85c56-2ea3-4efd-a319-92959c4b3e57 req-d403f9ad-17b7-4239-b0c6-809ba1598096 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:19.969783 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b6c85c56-2ea3-4efd-a319-92959c4b3e57 req-d403f9ad-17b7-4239-b0c6-809ba1598096 service nova] Creating event network-changed:234c364b-ee17-4a48-a122-11e6ffb25c40 for instance 79871b04-6603-485a-82e7-bbcd6dbf65dd on hv-cinder-83699 Jul 12 14:38:19.975044 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b6c85c56-2ea3-4efd-a319-92959c4b3e57 req-d403f9ad-17b7-4239-b0c6-809ba1598096 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030547 Jul 12 14:38:19.976010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 353/668] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:20.013128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:20.013904 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:20.020737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:20.021191 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:20.022021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:20.022461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:20.179921 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:20.185646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:20.191135 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7c0d7327-60a5-4c5f-b6f4-0e17363cb9a9 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.182606 Jul 12 14:38:20.193375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 354/669] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:20 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:20.283700 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:20.292317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:20.293861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:20.295031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5d408796-1a21-4bbd-824e-e7701a7ccdca tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.416886 Jul 12 14:38:20.295590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 316/670] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:19 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:21.208398 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:21.208917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:21.216107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:21.216559 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:21.217322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:21.217784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:21.313296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:21.313939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:21.320837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:21.321279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:21.322061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:21.322492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:21.350987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:21.358487 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-30d6ae6d-7dac-46bc-8836-00935c0cace7 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.154404 Jul 12 14:38:21.359056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 355/671] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:21 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:21.450884 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:21.458869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:21.460304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:21.461973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1335b592-344b-4fe3-8486-0d6a0e986557 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.152847 Jul 12 14:38:21.462527 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 317/672] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:21 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:22.375395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:22.376013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:22.383478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:22.383974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:22.384746 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:22.385189 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:22.481981 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:22.482707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:22.490146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:22.490684 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:22.491644 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:22.492134 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:22.518994 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:22.527966 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6bfdc43e-2d31-4843-99d9-31a4d0c62609 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.156430 Jul 12 14:38:22.529253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 356/673] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:22 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:22.632969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:22.641394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:22.642874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:22.644047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c36b5608-1465-4a4a-a306-9c500256603d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.166156 Jul 12 14:38:22.644791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 318/674] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:22 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:23.545820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:23.546494 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:23.552847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:23.553291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:23.554072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:23.555056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:23.663434 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:23.664111 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:23.670857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:23.671250 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:23.672030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:23.672468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:23.686176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:23.693887 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-263e1442-acca-4052-996c-da87f48cd32d tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.152117 Jul 12 14:38:23.694444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 357/675] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:23 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:23.801399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:23.809852 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:23.811347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:23.812750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5e2301e5-5b00-4231-b3f7-851a1c8e77fc tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.153201 Jul 12 14:38:23.813307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 319/676] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:23 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:24.713295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:24.713949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:24.720545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:24.721003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:24.721808 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:24.722247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:24.784684 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-e39a1cb1-b3d7-4be2-8f3c-f20c971be173 req-aaf603b4-4b02-4740-bbe8-b18674efa3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "name": "network-vif-plugged", "status": "completed", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:24.793451 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-e39a1cb1-b3d7-4be2-8f3c-f20c971be173 req-aaf603b4-4b02-4740-bbe8-b18674efa3f3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:24.793905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-e39a1cb1-b3d7-4be2-8f3c-f20c971be173 req-aaf603b4-4b02-4740-bbe8-b18674efa3f3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:24.805297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-e39a1cb1-b3d7-4be2-8f3c-f20c971be173 req-aaf603b4-4b02-4740-bbe8-b18674efa3f3 service nova] Creating event network-vif-plugged:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:38:24.810355 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-e39a1cb1-b3d7-4be2-8f3c-f20c971be173 req-aaf603b4-4b02-4740-bbe8-b18674efa3f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086350 Jul 12 14:38:24.810954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 320/677] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:24.831789 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:24.832515 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:24.839447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:24.840023 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:24.840808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:24.841252 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:24.858934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:24.869290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:24.877269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dcbc0243-f042-4c08-b196-847f11da85f8 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.169017 Jul 12 14:38:24.877875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 358/678] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:24 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:24.973895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:24.982966 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:24.984470 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:24.985733 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ccdbdb4b-c942-4bbb-849b-972cfbf2042f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.158199 Jul 12 14:38:24.986282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 321/679] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:24 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:25.895055 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:25.895662 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:25.902230 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:25.902679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:25.903435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:25.903863 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:26.003701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:26.004312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:26.010912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:26.011359 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:26.012124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:26.012558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:26.039395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:26.047027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3548deba-ba3a-494f-81d6-bcc96cfbf909 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.155793 Jul 12 14:38:26.047600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 359/680] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:25 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:26.142770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:26.151120 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:26.152556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:26.153734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-76aac785-2b28-4bb7-ae31-2c70f41ad48e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1744 microversion: 2.20 time: 0.153872 Jul 12 14:38:26.154285 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 322/681] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:25 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:27.064409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:27.065141 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:27.072342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:27.072872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:27.073760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:27.074272 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:27.172691 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:27.173915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:27.177130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=78 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:27.182372 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:27.182826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:27.183604 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:27.184744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:27.209375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:27.223855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-71ec4e30-664a-4082-a781-3fcafb781b86 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1577 microversion: 2.1 time: 0.163598 Jul 12 14:38:27.224439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 360/682] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:27 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:27.324131 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:27.332050 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:27.333598 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:27.334744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a36f390b-2852-4a16-97f0-8fb770487f6a tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1744 microversion: 2.20 time: 0.166650 Jul 12 14:38:27.335315 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 323/683] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:27 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:28.240042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:28.240605 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:28.243655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:28.250464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:28.250906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:28.251662 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:28.252091 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:28.352487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:28.353166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:28.359783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:28.360238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:28.361007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:28.361475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:28.383032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:28.390618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ee5f19c2-2a45-4c28-81b0-8cb83116200c tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1564 microversion: 2.1 time: 0.154508 Jul 12 14:38:28.391190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 361/684] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:28 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:28.496261 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:28.504073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:28.505614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:28.506770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-acbccf4e-142a-43e1-a15a-05ea16f1b3b6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1744 microversion: 2.20 time: 0.158771 Jul 12 14:38:28.507332 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 324/685] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:28 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:28.734449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-5a20cbc7-c415-4a88-b512-ed57aeae51c7 req-74d1a2d2-6b42-4193-8238-574922023aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "name": "network-vif-plugged", "status": "completed", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:28.743470 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5a20cbc7-c415-4a88-b512-ed57aeae51c7 req-74d1a2d2-6b42-4193-8238-574922023aed service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:28.744373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5a20cbc7-c415-4a88-b512-ed57aeae51c7 req-74d1a2d2-6b42-4193-8238-574922023aed service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:28.756442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-5a20cbc7-c415-4a88-b512-ed57aeae51c7 req-74d1a2d2-6b42-4193-8238-574922023aed service nova] Creating event network-vif-plugged:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:38:28.762112 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-5a20cbc7-c415-4a88-b512-ed57aeae51c7 req-74d1a2d2-6b42-4193-8238-574922023aed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031364 Jul 12 14:38:28.762701 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 362/686] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:29.477056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:29.477774 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:29.484897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.485672 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.486450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.486987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.525498 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:29.526192 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:29.537831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.543054 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.544150 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.544737 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.582335 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lazy-loading 'services' on Instance uuid 0fd4966f-fbaf-4a1e-b479-b56e448a0489 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:38:29.690511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-61b102f4-f4ea-4ffa-9825-de55af3d5e50 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments/aaa6889b-f822-471d-940b-02dbc1a49239" status: 202 len: 0 microversion: 2.1 time: 0.217746 Jul 12 14:38:29.691366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 325/687] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:38:29 2022] DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments/aaa6889b-f822-471d-940b-02dbc1a49239 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:38:29.702788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:29.708159 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:29.710095 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:29.717516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:29.717789 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.718471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.719519 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:29.719966 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:29.720600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:29.721364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8964f162-01eb-4085-abf3-0b81530be882 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.200436 Jul 12 14:38:29.728954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 363/688] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:29 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:29.761133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-47d4a999-a716-4abd-a83c-4d3facde9152 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064566 Jul 12 14:38:29.765465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 326/689] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:38:29 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:30.740145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:30.740812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:30.748330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:30.749032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:30.750137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:30.750579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:30.772763 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:30.774417 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:30.782677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:30.783376 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:30.784380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:30.794555 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:30.835795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-34cd279c-b00c-4f2e-8cef-b9ca18a952aa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067184 Jul 12 14:38:30.837004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 327/690] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:38:30 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:30.911725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:30.920481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:30.922338 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:30.923597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b8b18cfa-cf3b-41ba-b2d1-95a0bd03d0ec tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.187500 Jul 12 14:38:30.924234 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 364/691] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:30 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:31.847471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:31.848573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:31.856190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:31.856639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:31.857459 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:31.857902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:31.890699 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-882caf7e-81ab-442f-8f82-b23f3fe4670c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047397 Jul 12 14:38:31.891290 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 328/692] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:38:31 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 14:38:31.943174 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:31.943803 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:31.950266 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:31.950714 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:31.951469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:31.951902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.024188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:32.024686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:32.032039 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.032486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.033925 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.034369 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.062410 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:38:32.116459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:32.133180 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:32.135317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:32.136679 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-be623222-462d-4118-8c8e-9a379a42f187 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.197310 Jul 12 14:38:32.137397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 365/693] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:31 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:32.169262 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-580e607f-752a-43ce-a683-2531db81c23b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 204 len: 0 microversion: 2.1 time: 0.149043 Jul 12 14:38:32.173698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 329/694] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:38:32 2022] DELETE /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:38:32.180721 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:32.181363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:32.189213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.189811 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.190842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:32.194420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:32.334607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:32.343224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-369e31ed-0c19-45df-ac21-56e792f4e826 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.168026 Jul 12 14:38:32.344188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 366/695] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:32 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:33.156478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:33.157280 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:33.164530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:33.165187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:33.166118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:33.166615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:33.321508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:33.329810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:33.331313 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:33.332494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ce9bf561-6f0e-49c5-ac08-2dd24201c718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.180501 Jul 12 14:38:33.343595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 330/696] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:33 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:33.362505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:33.363249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:33.372708 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:33.373156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:33.374114 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:33.374548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:33.514791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:33.523307 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-930a2bec-ccbf-4cc6-a8e3-9362b9c39ea0 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.165897 Jul 12 14:38:33.527435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 367/697] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:33 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:34.352254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:34.352891 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:34.359506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:34.360095 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:34.360903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:34.361347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:34.506710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:34.515735 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:34.517311 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:34.518590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-58fd7174-ef2b-42b6-9fbc-bb75f0cae60b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.171540 Jul 12 14:38:34.519506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 331/698] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:34 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:34.540299 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:34.540910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:34.550157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:34.550619 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:34.551405 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:34.551843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:34.699173 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:34.707867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b1e71413-6bbd-4627-84c6-a32939ef565d tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.171848 Jul 12 14:38:34.709076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 368/699] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:34 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:35.536486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:35.537176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:35.543950 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:35.544427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:35.545223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:35.545719 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:35.685704 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:35.694867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:35.696561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:35.697885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c6a1d8f9-7243-4771-907d-c93af77210c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.165267 Jul 12 14:38:35.705245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 332/700] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:35 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:35.726159 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:35.727037 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:35.733493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:35.733949 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:35.734717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:35.735151 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:35.884689 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:35.892824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2caba3ae-e18b-419f-9f4c-71660fb7c128 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.170597 Jul 12 14:38:35.893433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 369/701] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:35 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:36.717149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:36.717901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:36.727584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:36.727584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:36.727584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:36.727584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:36.882867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:36.894282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:36.896655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:36.899053 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-171afddf-5fdb-4e6d-923b-5f31a04a122b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.185963 Jul 12 14:38:36.910129 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 333/702] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:36 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:36.915020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:36.915665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:36.922466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:36.925173 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:36.926104 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:36.926567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:37.070389 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:37.078640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bb196b28-e894-4bc9-ae77-755481a24289 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.167778 Jul 12 14:38:37.079462 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 370/703] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:36 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:37.916723 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:37.917377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:37.923800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:37.924254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:37.925028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:37.925552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:38.095633 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:38.096253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:38.103253 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:38.103708 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:38.104481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:38.104915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:38.216391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:38.224855 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:38.226475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:38.227804 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-836670b8-cf0e-40c8-8263-37fb457cd100 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1739 microversion: 2.20 time: 0.315466 Jul 12 14:38:38.228533 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 334/704] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:37 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:38.247321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:38.255404 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a1bc9eef-6e01-45ed-8538-99b2d3eaf159 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1687 microversion: 2.1 time: 0.163549 Jul 12 14:38:38.255972 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 371/705] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:38 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:38.784831 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-3d38a7aa-4537-45a2-be2c-91329ea18f7c req-3ef6eff7-65b9-409d-90b0-59044ec321c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd4966f-fbaf-4a1e-b479-b56e448a0489", "name": "network-vif-deleted", "tag": "9d96821d-569c-41d0-bbf8-2b14b5817375"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:38.792803 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-3d38a7aa-4537-45a2-be2c-91329ea18f7c req-3ef6eff7-65b9-409d-90b0-59044ec321c1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:38.793250 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-3d38a7aa-4537-45a2-be2c-91329ea18f7c req-3ef6eff7-65b9-409d-90b0-59044ec321c1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:38.804841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-3d38a7aa-4537-45a2-be2c-91329ea18f7c req-3ef6eff7-65b9-409d-90b0-59044ec321c1 service nova] Creating event network-vif-deleted:9d96821d-569c-41d0-bbf8-2b14b5817375 for instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 on hv-cinder-83699 Jul 12 14:38:38.810109 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-3d38a7aa-4537-45a2-be2c-91329ea18f7c req-3ef6eff7-65b9-409d-90b0-59044ec321c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028831 Jul 12 14:38:38.813999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 335/706] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:39.247433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:39.248177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:39.254857 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:39.255337 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:39.256111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:39.256543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:39.260666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:39.274367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:39.275084 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:39.281725 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:39.282257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:39.283093 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:39.283600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:39.315778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:39.331224 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:39.331928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:39.332378 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lazy-loading 'fault' on Instance uuid 0fd4966f-fbaf-4a1e-b479-b56e448a0489 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:38:39.379307 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:39.387390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a2620481-cbb4-4d11-b3ed-bec0f4bff904 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 200 len: 1334 microversion: 2.1 time: 0.117738 Jul 12 14:38:39.387955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 336/707] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:39 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 1334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:39.415945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:39.424825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:39.426605 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:39.427945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-03bfece8-f142-47bf-b130-7704e87bbdbb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1721 microversion: 2.20 time: 0.185060 Jul 12 14:38:39.428630 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 372/708] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:39 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:40.403894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:40.404530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 0fd4966f-fbaf-4a1e-b479-b56e448a0489] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:40.411319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:40.411771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:40.412550 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:40.412985 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:40.426153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] HTTP exception thrown: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Request method failure captured: Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 HTTP/1.1 Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZctuhuOnn0F060zgZShYesLmWYTZb3V91v33sZDj3CCEn2j51pNFdFnHRdkvf8-nod7Vidl-6iGgdytrdKIn7NQg_FQ77pQ48XRRrNbUJwj3Td3qevlP9zx9PQLp4PudE0Iz3dndnEUYz82HZ3JgD9CvDqLZ-z6c8bzgPEYC9J1Cg Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:38:40.427817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_926f1338d73b48aebc0431e2121a0dba", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: a48066ed22e14c64a316fe4d66394f44 Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. Jul 12 14:38:40.429974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '0fd4966f-fbaf-4a1e-b479-b56e448a0489'} Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:38:40.430880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. Jul 12 14:38:40.432383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:38:40.433823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Returning 404 to user: Instance 0fd4966f-fbaf-4a1e-b479-b56e448a0489 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:38:40.433823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ad833dd9-c29f-4e69-a7f5-ebaec3c7906b tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jul 12 14:38:40.433823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 337/709] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:40 2022] GET /compute/v2.1/servers/0fd4966f-fbaf-4a1e-b479-b56e448a0489 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:38:40.438544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1d8ccdc9-576f-48cf-bf3b-3c300f136bfd tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '.version_select at 0x7f01d31ccee0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:40.448077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:40.448691 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:40.455191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:40.455642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:40.456245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1d8ccdc9-576f-48cf-bf3b-3c300f136bfd tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499898226" status: 202 len: 0 microversion: 2.1 time: 0.021580 Jul 12 14:38:40.456409 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:40.456811 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 373/710] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 14:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499898226 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:38:40.456954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:40.586795 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:40.595832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:40.597536 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:40.598705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4ffae3d8-bfff-4404-9e7a-cec17a622ca5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1721 microversion: 2.20 time: 0.154932 Jul 12 14:38:40.599253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 338/711] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:40 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:40.792433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-79078227-1c54-467a-a9d0-06e00d815637 req-d21b70a9-70d0-4781-8e1a-928db1376b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "name": "network-vif-unplugged", "status": "completed", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:40.802363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-79078227-1c54-467a-a9d0-06e00d815637 req-d21b70a9-70d0-4781-8e1a-928db1376b91 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:40.803188 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-79078227-1c54-467a-a9d0-06e00d815637 req-d21b70a9-70d0-4781-8e1a-928db1376b91 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:40.815021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-79078227-1c54-467a-a9d0-06e00d815637 req-d21b70a9-70d0-4781-8e1a-928db1376b91 service nova] Creating event network-vif-unplugged:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:38:40.820710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-79078227-1c54-467a-a9d0-06e00d815637 req-d21b70a9-70d0-4781-8e1a-928db1376b91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033203 Jul 12 14:38:40.821632 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 374/712] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:41.617327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:41.617978 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:41.625056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:41.625690 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:41.626546 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:41.627094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:41.754888 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:41.762906 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:41.764430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:41.765621 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-50645a02-a4c1-4bf4-ad84-4eec97557dc0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1721 microversion: 2.20 time: 0.152215 Jul 12 14:38:41.766182 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 339/713] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:41 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:42.785001 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:42.785761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:42.792631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:42.793082 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:42.793893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:42.794330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:42.930105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:42.938330 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:42.939820 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:42.940964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eed071b1-96ae-4679-a695-751c6059a998 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1724 microversion: 2.20 time: 0.160764 Jul 12 14:38:42.941542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 375/714] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:42 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:42.958614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cde5a48-ec1a-43a0-a3de-89590a858cc3"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:42.959771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:42.967151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:42.967609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:42.968414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:42.968880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.224556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f847ef9c-0a7f-456d-baf8-1f495642b6c5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.269878 Jul 12 14:38:43.225151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 340/715] 10.222.0.25 () {62 vars in 1363 bytes} [Tue Jul 12 14:38:42 2022] POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments => generated 188 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 14:38:43.325190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:43.325734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:43.331762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.332289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.333089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.333563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.337740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:43.338239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:43.344081 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.344523 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.345277 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.345736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.361314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:38:43.439674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7b059aa3-ddf0-405f-ab27-dbd12133a9b8 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 204 len: 0 microversion: 2.1 time: 0.118256 Jul 12 14:38:43.440596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 376/716] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:38:43 2022] DELETE /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:38:43.449432 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:43.450537 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:43.456698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.456914 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.457650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.458138 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.588834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:43.596560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-63fe0d6c-3fde-4660-8192-66df9bdb1129 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1508 microversion: 2.1 time: 0.151601 Jul 12 14:38:43.597137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 377/717] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:43 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:43.612480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d613f8ba-6a9d-4de7-b274-eba544ac0813 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments/4cde5a48-ec1a-43a0-a3de-89590a858cc3" status: 202 len: 0 microversion: 2.20 time: 0.278999 Jul 12 14:38:43.613059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 341/718] 10.222.0.25 () {60 vars in 1456 bytes} [Tue Jul 12 14:38:43 2022] DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments/4cde5a48-ec1a-43a0-a3de-89590a858cc3 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 14:38:43.668205 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:43.668766 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:43.674739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.675158 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.675912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.676335 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.750516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cac7cf0c-3ea9-4a3f-a88f-ea8e5f1187a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/action" status: 202 len: 0 microversion: 2.20 time: 0.087423 Jul 12 14:38:43.751113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 378/719] 10.222.0.25 () {62 vars in 1318 bytes} [Tue Jul 12 14:38:43 2022] POST /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:38:43.759310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:43.759928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:43.766424 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.766883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.767670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:43.768118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:43.905406 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:43.913500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:43.915000 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:43.916155 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4d2af2f5-b8c8-4d97-a5de-5e93b5cd9713 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1672 microversion: 2.20 time: 0.160890 Jul 12 14:38:43.916706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 342/720] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:43 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:44.614990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:44.615676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:44.621720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:44.622169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:44.622931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:44.623362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:44.758292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:44.765898 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-58e02788-d64e-4361-82c8-2d07e0872b08 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1508 microversion: 2.1 time: 0.155345 Jul 12 14:38:44.766468 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 379/721] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:44 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:44.935030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:44.935556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:44.942282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:44.942726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:44.943478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:44.943909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:45.074627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:45.082514 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:45.084251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:45.085482 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6a4fb642-c5a0-4095-a89a-9c88c7c34137 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1672 microversion: 2.20 time: 0.154554 Jul 12 14:38:45.086039 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 343/722] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:44 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:45.783011 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:45.783529 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:45.790130 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:45.790580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:45.791347 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:45.791783 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:45.917569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:45.924969 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a4ee678d-6f55-46b2-a23d-abb5968970af tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1508 microversion: 2.1 time: 0.145911 Jul 12 14:38:45.925566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 380/723] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:45 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:46.103986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:46.104605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:46.111080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:46.111532 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:46.112298 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:46.112737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:46.239805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:46.249136 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:46.250697 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:46.251885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0876c6b8-da20-4f13-8e69-16315bc1c6a5 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1672 microversion: 2.20 time: 0.152382 Jul 12 14:38:46.252448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 344/724] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:46 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:46.942894 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:46.943776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:46.950873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:46.951420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:46.952274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:46.952785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:47.081016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:47.088487 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-102be2ca-a0dc-458a-9528-e0bde491cee9 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1508 microversion: 2.1 time: 0.149516 Jul 12 14:38:47.089056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 381/725] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:46 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:47.270379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:47.270947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:47.278763 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:47.279127 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:47.281511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:47.281511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:47.582294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:47.590599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:47.592102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:47.593250 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-733a66fd-f3da-4227-aa8b-4e35f682f3d9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.326892 Jul 12 14:38:47.594030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 345/726] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:47 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:48.106711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:48.107356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:48.113959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.114410 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.115178 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.115616 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.190098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:48.202905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3e921031-65b8-46bc-b234-057d6a38391c tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 200 len: 1466 microversion: 2.1 time: 0.100328 Jul 12 14:38:48.203780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 382/727] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:48 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 1466 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:48.286798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-d2477e24-590d-465b-9367-0e4dae493038 req-5e98961c-1cb8-4d9e-b8eb-3d90f9eef21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56f8c4f-6c63-450b-a04a-33fbe82ae3f4", "name": "network-vif-deleted", "tag": "bd8f73f6-86cd-474b-9140-d7a87f77ccc7"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:48.299689 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d2477e24-590d-465b-9367-0e4dae493038 req-5e98961c-1cb8-4d9e-b8eb-3d90f9eef21d service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.300137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d2477e24-590d-465b-9367-0e4dae493038 req-5e98961c-1cb8-4d9e-b8eb-3d90f9eef21d service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.312895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-d2477e24-590d-465b-9367-0e4dae493038 req-5e98961c-1cb8-4d9e-b8eb-3d90f9eef21d service nova] Creating event network-vif-deleted:bd8f73f6-86cd-474b-9140-d7a87f77ccc7 for instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 on hv-cinder-83699 Jul 12 14:38:48.318340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-d2477e24-590d-465b-9367-0e4dae493038 req-5e98961c-1cb8-4d9e-b8eb-3d90f9eef21d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036194 Jul 12 14:38:48.320052 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 346/728] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:48.488476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:48.488896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:48.495502 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.495899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.496667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.497099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.521551 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-31051d92-fae6-4195-873e-fa55504d4a87 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/ips" status: 200 len: 149 microversion: 2.1 time: 0.037545 Jul 12 14:38:48.522120 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 383/729] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:38:48 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:38:48.612388 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:48.613087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:48.619860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.620407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.621191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:48.621646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:48.766911 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:48.775395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:48.776992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:48.778467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-263e6ded-a3bc-4bdc-904d-93f7b1d8f9a3 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.170129 Jul 12 14:38:48.779618 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 347/730] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:48 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:49.219766 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:49.220375 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: d56f8c4f-6c63-450b-a04a-33fbe82ae3f4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:49.228913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.229453 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.230353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.230794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.247316 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] HTTP exception thrown: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Request method failure captured: Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 HTTP/1.1 Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYZctuhuOnn0F060zgZShYesLmWYTZb3V91v33sZDj3CCEn2j51pNFdFnHRdkvf8-nod7Vidl-6iGgdytrdKIn7NQg_FQ77pQ48XRRrNbUJwj3Td3qevlP9zx9PQLp4PudE0Iz3dndnEUYz82HZ3JgD9CvDqLZ-z6c8bzgPEYC9J1Cg Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:38:49.249186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_926f1338d73b48aebc0431e2121a0dba", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: a48066ed22e14c64a316fe4d66394f44 Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. Jul 12 14:38:49.251530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'd56f8c4f-6c63-450b-a04a-33fbe82ae3f4'} Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:38:49.252550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. Jul 12 14:38:49.254228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:38:49.255573 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Returning 404 to user: Instance d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:38:49.255573 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9e6d2a26-b5eb-4b5c-a360-c8aa3b959bbc tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4" status: 404 len: 111 microversion: 2.1 time: 0.035167 Jul 12 14:38:49.255573 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 384/731] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:49 2022] GET /compute/v2.1/servers/d56f8c4f-6c63-450b-a04a-33fbe82ae3f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:38:49.261764 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:49.262277 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:49.268443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.268907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.269727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.270156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.300479 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:38:49.341260 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:49.411782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bdef36c7-46c1-40d3-ac9e-ddf2b0334d21 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "DELETE /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 204 len: 0 microversion: 2.1 time: 0.154261 Jul 12 14:38:49.419136 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 348/732] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:38:49 2022] DELETE /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:38:49.427495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:49.428450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:49.438004 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.439143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.440407 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.441221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.605083 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:49.612917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4d15fe81-1fe3-48d1-a108-cb9cc461af09 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.189546 Jul 12 14:38:49.613677 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 385/733] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:49 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:49.799747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:49.800938 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:49.809846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.810827 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.812898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.813611 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.875816 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c3923d2-fa2f-4f2b-9af7-f1945dc9841a"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:38:49.876947 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:49.883449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.883904 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.884682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:49.885129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:49.962411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:49.972933 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:49.974744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:49.976144 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6f912022-4028-4dff-86b5-45e8667751ad tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.183413 Jul 12 14:38:49.976839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 349/734] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:49 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:50.630186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:50.630850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:50.637395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:50.637847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:50.638611 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:50.639046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:50.774465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:50.781951 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-207b6883-343e-4434-b6ce-69dd586b5d35 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.155636 Jul 12 14:38:50.782510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 350/735] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:50 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:50.999810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:51.000905 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:51.012713 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:51.014353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:51.015326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:51.015993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:51.149438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:51.157231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:51.158751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:51.159895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-72db3c85-7f2a-489d-aff7-5a0b67d1f8da tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.167380 Jul 12 14:38:51.160443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 351/736] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:50 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:38:51.800367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:51.801151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:51.809132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:51.810015 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:51.811068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:51.811824 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:51.951593 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:51.961814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-09d7b5b8-b96e-4dce-a842-b67dc9fd88a4 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.165920 Jul 12 14:38:51.964541 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 352/737] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:51 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:52.178463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:52.179655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:52.185728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:52.186174 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:52.186961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:52.187646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:52.326837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:52.336344 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:52.337932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:52.339149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-48f83aec-a00b-448f-b9bc-78a7afe9311d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.164747 Jul 12 14:38:52.339757 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 353/738] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:52 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:52.980822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:52.981485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:52.987935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:52.988383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:52.989149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:52.989613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:53.132769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:53.140216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e95daecf-d6c8-4309-a8be-9162032150f2 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.163342 Jul 12 14:38:53.140779 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 354/739] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:52 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:53.357305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:53.357941 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:53.364059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:53.364513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:53.365279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:53.365742 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:53.508288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:53.517444 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:53.519094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:53.520337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2468d5c7-a820-4097-acd3-414d17c4144d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.166955 Jul 12 14:38:53.520908 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 355/740] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:53 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:54.156800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:54.157552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:54.164253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:54.164698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:54.165495 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:54.165927 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:54.312220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:54.320886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-221cdda1-b664-4200-ac83-f919242bf203 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.167851 Jul 12 14:38:54.321670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 356/741] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:54 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:54.539910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:54.540519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:54.546558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:54.547007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:54.547766 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:54.548207 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:54.690779 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:54.698971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:54.700474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:54.701655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4907fece-594b-4c24-bef3-a82b62ee1f5c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.166220 Jul 12 14:38:54.702219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 357/742] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:54 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:55.337709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:55.338387 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:55.344792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:55.345266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:55.346090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:55.346525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:55.482035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:55.489615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2e84f9c6-d2f8-4fda-9deb-ccf30c57c0ac tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.155735 Jul 12 14:38:55.490176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 358/743] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:55 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:55.719996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:55.720693 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:55.727263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:55.727724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:55.728497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:55.728937 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:55.871485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:55.879623 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:55.881125 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:55.882356 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ba4d252b-78b3-4da4-b03a-e6e8e7e49c95 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.166409 Jul 12 14:38:55.882907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 359/744] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:55 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:56.507132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:56.507836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:56.514265 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:56.514922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:56.516528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:56.516982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:56.663566 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:56.671321 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5e4be943-f146-48da-a7d8-cef5d364f3f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.168154 Jul 12 14:38:56.671894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 360/745] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:56 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:56.900398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:56.901012 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:56.907156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:56.907610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:56.908375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:56.908811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:57.056069 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:57.064353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:57.065887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:57.067056 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f005bcc5-5da6-4519-b4d6-e9ee47f5cee2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.170635 Jul 12 14:38:57.067619 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 361/746] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:56 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:57.690113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:57.690750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:57.694271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:57.698430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:57.698889 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:57.699676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:57.700115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:57.835629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:57.842994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4f1f51a2-7299-4e75-ad0a-98b314fb39cb tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.157292 Jul 12 14:38:57.843553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 362/747] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:57 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:38:58.087153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:58.087760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:58.093892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:58.094332 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:58.095082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:58.095513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:58.240870 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:58.249850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:58.251454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:58.252620 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0de63803-dca9-4acb-9424-311f56d6c6cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.170398 Jul 12 14:38:58.253177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 363/748] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:58 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:58.861813 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:58.862616 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:58.875892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:58.875892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:58.875892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:58.875892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:58.877910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:59.028895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:59.036600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f8cda9df-f7ea-4d2f-a245-4817af36fcfa tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.180060 Jul 12 14:38:59.037169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 364/749] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:38:58 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:38:59.272664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:38:59.273281 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:38:59.279244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:59.279687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:59.280447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:38:59.280876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:38:59.419807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:59.427850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:59.430066 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:38:59.431229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8835ecb5-b9e6-46a6-859e-985f45fc5e49 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.163069 Jul 12 14:38:59.431798 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 365/750] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:38:59 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:38:59.881239 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:38:59.960213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:00.053158 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:00.053880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:00.060380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:00.060826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:00.061626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:00.062064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:00.193208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:00.202060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9e65decb-1fdf-4d52-a3e7-1b3a36b5f8ad tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.152694 Jul 12 14:39:00.202557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 366/751] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:00 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:00.449910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:00.450669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:00.456755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:00.457142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:00.457954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:00.458388 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:00.586889 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:00.594791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:00.596293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:00.597477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7593c381-a735-43d7-95ba-a4e0fd04eeed tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.151433 Jul 12 14:39:00.598172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 367/752] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:00 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:01.219694 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:01.220363 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:01.227592 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:01.228040 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:01.228807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:01.229241 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:01.358420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:01.365835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f2a29568-5cd7-471a-83e0-1da9dfc32161 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.150002 Jul 12 14:39:01.366922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 368/753] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:01 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:01.615989 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:01.617273 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:01.623337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:01.623787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:01.624553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:01.624994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:01.756102 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:01.764790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:01.766339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:01.767504 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d3140e33-eab3-4292-a264-ccb47e295b48 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.155490 Jul 12 14:39:01.768063 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 369/754] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:01 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:02.382487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:02.383153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:02.389629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:02.390077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:02.390838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:02.391271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:02.521028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:02.529002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-239ea102-9d5a-4c18-a52c-41bf50728d60 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.150436 Jul 12 14:39:02.529596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 370/755] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:02 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:02.786257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:02.786811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:02.793502 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:02.793950 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:02.794710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:02.795143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:02.925649 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:02.933676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:02.935176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:02.936321 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8fcbf5bd-18a5-4670-89c2-895971c7e206 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.154039 Jul 12 14:39:02.936886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 371/756] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:02 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:03.545861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:03.546476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:03.553061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:03.553547 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:03.554316 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:03.554754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:03.683469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:03.691266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8f517e83-a0fd-4e34-a6eb-a4a6aa52b2f1 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.149242 Jul 12 14:39:03.691825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 372/757] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:03 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:03.953747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:03.954360 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:03.960409 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:03.960868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:03.961642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:03.962080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:04.080326 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-65c27b39-a48b-4796-bfd7-2ff249270232 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "POST /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.208418 Jul 12 14:39:04.081244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 386/758] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:38:49 2022] POST /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 194 bytes in 14210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:04.105420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:04.113634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:04.115186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:04.116976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3e68f160-73e4-4972-8cfd-c5967023abe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.167177 Jul 12 14:39:04.117706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 373/759] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:03 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:04.711058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:04.711690 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:04.718415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:04.718858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:04.719613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:04.720043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:04.856489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:04.863943 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-90a6493c-cf1d-414a-8145-78d0b87b7266 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1523 microversion: 2.1 time: 0.159617 Jul 12 14:39:04.864524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 387/760] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:04 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:05.138997 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:05.140233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:05.147617 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:05.148061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:05.148960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:05.149423 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:05.285159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:05.293173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:05.294687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:05.295836 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ceef6686-6641-481f-9f95-7fdc22f0d41e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.165005 Jul 12 14:39:05.296379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 374/761] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:05 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:05.845833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-c4fdaa51-9313-44ae-b097-a1579e27df61 req-7925a154-f1cd-45ee-aa2c-5440c4d058c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961281e0-0b38-46fe-b815-0482022c76b0", "name": "network-vif-deleted", "tag": "485772cd-dc9e-4a9a-b8ec-bf7735f23b53"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:05.855003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c4fdaa51-9313-44ae-b097-a1579e27df61 req-7925a154-f1cd-45ee-aa2c-5440c4d058c4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:05.855570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-c4fdaa51-9313-44ae-b097-a1579e27df61 req-7925a154-f1cd-45ee-aa2c-5440c4d058c4 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:05.867232 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-c4fdaa51-9313-44ae-b097-a1579e27df61 req-7925a154-f1cd-45ee-aa2c-5440c4d058c4 service nova] Creating event network-vif-deleted:485772cd-dc9e-4a9a-b8ec-bf7735f23b53 for instance 961281e0-0b38-46fe-b815-0482022c76b0 on hv-cinder-83699 Jul 12 14:39:05.871851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-c4fdaa51-9313-44ae-b097-a1579e27df61 req-7925a154-f1cd-45ee-aa2c-5440c4d058c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jul 12 14:39:05.872427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 388/762] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:05.881406 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:05.882600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:05.888790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:05.889268 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:05.890249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:05.891027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:05.958729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48066ed22e14c64a316fe4d66394f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926f1338d73b48aebc0431e2121a0dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:05.966420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-058d67af-f76b-4997-9408-80812f735897 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 200 len: 1307 microversion: 2.1 time: 0.088886 Jul 12 14:39:05.967002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 375/763] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:05 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:06.315450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:06.316072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:06.322340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:06.322812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:06.323607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:06.324051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:06.466211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:06.474357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:06.476446 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:06.477646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-861e159d-a9d1-4100-80b2-26a98e36d94f tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.166873 Jul 12 14:39:06.478216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 389/764] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:06 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:06.983893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:06.984424 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] [instance: 961281e0-0b38-46fe-b815-0482022c76b0] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:06.991670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:06.992123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:06.992893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:06.993357 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:07.007308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] HTTP exception thrown: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Request method failure captured: Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 HTTP/1.1 Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZctuhuOnn0F060zgZShYesLmWYTZb3V91v33sZDj3CCEn2j51pNFdFnHRdkvf8-nod7Vidl-6iGgdytrdKIn7NQg_FQ77pQ48XRRrNbUJwj3Td3qevlP9zx9PQLp4PudE0Iz3dndnEUYz82HZ3JgD9CvDqLZ-z6c8bzgPEYC9J1Cg Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:07.009026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/926f1338d73b48aebc0431e2121a0dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_926f1338d73b48aebc0431e2121a0dba", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 926f1338d73b48aebc0431e2121a0dba Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-103819946 Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: a48066ed22e14c64a316fe4d66394f44 Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-103819946-project Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. Jul 12 14:39:07.010698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '961281e0-0b38-46fe-b815-0482022c76b0'} Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:07.011521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. Jul 12 14:39:07.013059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:07.014579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] Returning 404 to user: Instance 961281e0-0b38-46fe-b815-0482022c76b0 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:07.014579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-77fb6987-0e60-40f2-a788-f1313d1fae11 tempest-ServerRescueNegativeTestJSON-103819946 tempest-ServerRescueNegativeTestJSON-103819946-project] 10.222.0.25 "GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0" status: 404 len: 111 microversion: 2.1 time: 0.030569 Jul 12 14:39:07.014579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 376/765] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:06 2022] GET /compute/v2.1/servers/961281e0-0b38-46fe-b815-0482022c76b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:07.496771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:07.497570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:07.504319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:07.504792 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:07.505674 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:07.506176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:07.640959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:07.649085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:07.650634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:07.651801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3561894d-1ee5-4826-9d8a-4045867e2fe4 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.159483 Jul 12 14:39:07.652358 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 390/766] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:07 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:08.670324 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:08.671437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:08.679133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:08.679687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:08.680587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:08.681123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:09.021074 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-9b59cfcf-481d-4dfd-b2b8-03382f0c387d req-dacf1c03-1ebc-4fa5-b887-e0a25c9ff9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "name": "network-vif-plugged", "status": "completed", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:09.037391 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:09.039763 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9b59cfcf-481d-4dfd-b2b8-03382f0c387d req-dacf1c03-1ebc-4fa5-b887-e0a25c9ff9a8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:09.041281 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-9b59cfcf-481d-4dfd-b2b8-03382f0c387d req-dacf1c03-1ebc-4fa5-b887-e0a25c9ff9a8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:09.049885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:09.051414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:09.052599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d791a7aa-26f1-4a11-9c9b-033411667aab tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.386337 Jul 12 14:39:09.053685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 377/767] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:08 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:09.056627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-9b59cfcf-481d-4dfd-b2b8-03382f0c387d req-dacf1c03-1ebc-4fa5-b887-e0a25c9ff9a8 service nova] Creating event network-vif-plugged:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:39:09.063854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-9b59cfcf-481d-4dfd-b2b8-03382f0c387d req-dacf1c03-1ebc-4fa5-b887-e0a25c9ff9a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050803 Jul 12 14:39:09.065256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 391/768] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:10.072149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:10.072768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:10.079548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:10.080005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:10.080784 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:10.081225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:10.295467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:10.305162 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:10.307156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:10.308420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fdd4cda5-8444-4cb8-9cc9-481135724d5d tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.240848 Jul 12 14:39:10.309864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 378/769] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:10 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:11.328383 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:11.329085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:11.336752 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:11.337512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:11.338480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:11.339085 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:11.494699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:11.503558 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:11.504923 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:11.506119 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-da946fa3-d272-4b6b-a81e-722137e55e22 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1730 microversion: 2.20 time: 0.181935 Jul 12 14:39:11.517942 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 392/770] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:11 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:11.769478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b7400de6-4a91-4b75-8ae6-b0272c4193dc tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Action: 'create', calling method: .version_select at 0x7f01ce959940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-803747147"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:12.068385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b7400de6-4a91-4b75-8ae6-b0272c4193dc tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.417242 Jul 12 14:39:12.069585 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 379/771] 10.222.0.25 () {60 vars in 1154 bytes} [Tue Jul 12 14:39:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 14:39:12.082567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3bff3225-9d56-4075-bc4c-955e9bd7c033 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d31cc700>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:12.132104 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3bff3225-9d56-4075-bc4c-955e9bd7c033 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 200 len: 344 microversion: 2.1 time: 0.055029 Jul 12 14:39:12.132664 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 393/772] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:12 2022] GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:12.524563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:12.525203 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:12.531966 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:12.532420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:12.533186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:12.533650 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:12.675721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:12.684374 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:12.685910 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:12.687130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-75e1fe01-cb90-4048-b508-2ea75c1917c9 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1717 microversion: 2.20 time: 0.167151 Jul 12 14:39:12.687928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 380/773] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:12 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:12.780703 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:12.781200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:12.787186 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:12.787617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:12.788372 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:12.788806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:12.868919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lazy-loading 'services' on Instance uuid eb2e928a-5e26-4720-ac84-a3d5d46ae967 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:39:12.996464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-237eab84-717d-411d-905d-88bbdf45d80d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments/2c3923d2-fa2f-4f2b-9af7-f1945dc9841a" status: 202 len: 0 microversion: 2.1 time: 0.219905 Jul 12 14:39:12.997051 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 394/774] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:39:12 2022] DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments/2c3923d2-fa2f-4f2b-9af7-f1945dc9841a => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:13.005237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:13.006319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:13.012516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:13.012963 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:13.013756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:13.014182 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:13.043490 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fba950f4-0aa4-4f70-a8c7-0b3ae2bc3247 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Jul 12 14:39:13.044043 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 381/775] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:39:13 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:13.145579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-72f90d72-3440-4cca-a5bc-74f8525164c2 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d31dea60>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:13.192655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-72f90d72-3440-4cca-a5bc-74f8525164c2 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 200 len: 345 microversion: 2.1 time: 0.051548 Jul 12 14:39:13.193246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 395/776] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:13 2022] GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:13.204343 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5506a52b-aa10-4a81-9fd7-cc1273fca4fa tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Action: 'create', calling method: .version_select at 0x7f01ce970b80>, body: {"snapshot": {"volume_id": "546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1410981106"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:13.353809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5506a52b-aa10-4a81-9fd7-cc1273fca4fa tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153177 Jul 12 14:39:13.354476 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 382/777] 10.222.0.25 () {60 vars in 1161 bytes} [Tue Jul 12 14:39:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:13.365002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f4a9625e-5b91-42d0-b37d-fb934577c76f tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01caddf160>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:13.394436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f4a9625e-5b91-42d0-b37d-fb934577c76f tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 287 microversion: 2.1 time: 0.033110 Jul 12 14:39:13.395009 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 396/778] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:13 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:13.405233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7684ddbb-0b42-46e6-bf3f-8f22dfe1d535 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01ce9af8b0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:13.449021 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7684ddbb-0b42-46e6-bf3f-8f22dfe1d535 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047487 Jul 12 14:39:13.449664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 383/779] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Jul 12 14:39:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:13.460016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4b110865-c085-4c93-8f6e-2106c3dc454d tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d319eee0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:13.489946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4b110865-c085-4c93-8f6e-2106c3dc454d tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 287 microversion: 2.1 time: 0.034115 Jul 12 14:39:13.490507 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 397/780] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:13 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:14.055947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:14.057538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:14.063901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:14.064350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:14.065118 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:14.065599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:14.078717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:14.094540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0242c5cd-88d5-4200-aaa5-2c46c85ef8d6 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Jul 12 14:39:14.095094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 384/781] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:39:14 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:14.501640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75ed83bc-9aa9-4da7-bf17-1279b10bbb33 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01caa743a0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:14.536237 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-75ed83bc-9aa9-4da7-bf17-1279b10bbb33 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 287 microversion: 2.1 time: 0.038868 Jul 12 14:39:14.536832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 398/782] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:14 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:15.106365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:15.107295 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:15.113768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:15.114216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:15.114972 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:15.115402 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:15.146394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7d35a83b-bf01-4819-8677-ecef27600d46 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Jul 12 14:39:15.147525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 385/783] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:39:15 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:15.548200 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5cc00c41-79eb-4d1b-aeb5-229998b432d1 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d3237e50>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:15.577971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5cc00c41-79eb-4d1b-aeb5-229998b432d1 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 287 microversion: 2.1 time: 0.034035 Jul 12 14:39:15.578522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 399/784] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:15 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:16.158446 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:16.159364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:16.166443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:16.166886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:16.167640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:16.168071 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:16.198395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cf8fdb43-0ea8-4a91-99a7-348d46b54f7a tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jul 12 14:39:16.198955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 386/785] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:39:16 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:16.591009 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-be5f412e-9541-4b8a-92df-74f204a4776f tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d31faa60>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:16.623517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-be5f412e-9541-4b8a-92df-74f204a4776f tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 288 microversion: 2.1 time: 0.036843 Jul 12 14:39:16.624078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 400/786] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:16 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:16.635847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-35601437-176a-4323-b405-5c1a1b51bd3c tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01ce933310>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:16.694701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-35601437-176a-4323-b405-5c1a1b51bd3c tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 202 len: 0 microversion: 2.1 time: 0.062370 Jul 12 14:39:16.694701 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 387/787] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 12 14:39:16 2022] DELETE /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:16.702884 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6fcda8af-6dff-4806-adb2-deb05b949cf2 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01cad393a0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:16.732997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6fcda8af-6dff-4806-adb2-deb05b949cf2 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 200 len: 287 microversion: 2.1 time: 0.033797 Jul 12 14:39:16.733609 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 401/788] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:16 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:17.210512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.211470 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:17.217559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.218014 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.218783 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.219214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.247669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-89e6d530-d34c-4a90-9561-60a4602df4eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041643 Jul 12 14:39:17.248229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 388/789] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:39:17 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:39:17.305448 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.306146 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:17.314153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.314610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.315381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.315822 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.340619 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:39:17.421853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-30cbd221-7efe-46b3-b4b8-963fdc8dec50 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 204 len: 0 microversion: 2.1 time: 0.120586 Jul 12 14:39:17.423517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 402/790] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:17 2022] DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:39:17.431471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.432156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:17.438497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.438939 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.439691 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:17.440123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:17.569275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:17.576771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3a97ec62-4960-45a0-94e6-1c0f6aec7960 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1680 microversion: 2.1 time: 0.149169 Jul 12 14:39:17.577353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 389/791] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:17 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:17.745956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e69eacfb-1c25-4ced-b1c0-894d82de8e11 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01caddfd30>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.771613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-e69eacfb-1c25-4ced-b1c0-894d82de8e11 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] HTTP exception thrown: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e69eacfb-1c25-4ced-b1c0-894d82de8e11 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Request method failure captured: Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c HTTP/1.1 Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYePLBtdOnuBCYtmGQaUFDlgHaXTiugxyT66SZDm5ahCoHWKKiP_NqL9_RI9f1FT30qcNPYWkx6xRBMna7Nr1yaangtt9wl3GRfK1n08CkOzJbs2VFnZYJ5zDcaD9nh9B0z0kXwz29iodNa0P9N7XJZiyaeQoTU64GjmZyxGTe3W90k Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:17.774728 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/decc10c5e64842e38d528c832429351c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_decc10c5e64842e38d528c832429351c", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 8329adf3b3b14eb488f0473e2b61e48b Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'f8bc2dad-64d2-40d0-bd51-2adb264ab25c'} Jul 12 14:39:17.776283 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. (HTTP 404) (Request-ID: req-e9bf916d-ad40-40ba-a17e-da3a0ba6ff6b) Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.777289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:17.778620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 14:39:17.779976 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e69eacfb-1c25-4ced-b1c0-894d82de8e11 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Returning 404 to user: Snapshot f8bc2dad-64d2-40d0-bd51-2adb264ab25c could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:17.781823 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e69eacfb-1c25-4ced-b1c0-894d82de8e11 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c" status: 404 len: 111 microversion: 2.1 time: 0.034454 Jul 12 14:39:17.782759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 403/792] 10.222.0.25 () {58 vars in 1250 bytes} [Tue Jul 12 14:39:17 2022] GET /compute/v2.1/os-snapshots/f8bc2dad-64d2-40d0-bd51-2adb264ab25c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:17.785133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-49744e3a-6bf7-4e29-9fc3-949e809d9ccb tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01ce970dc0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.844493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-49744e3a-6bf7-4e29-9fc3-949e809d9ccb tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 202 len: 0 microversion: 2.1 time: 0.063379 Jul 12 14:39:17.845094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 390/793] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:17 2022] DELETE /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:17.854575 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cd623b57-0b49-4e30-a3b2-507d77b788c8 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d324ef70>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:17.901354 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cd623b57-0b49-4e30-a3b2-507d77b788c8 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 200 len: 344 microversion: 2.1 time: 0.051952 Jul 12 14:39:17.901928 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 404/794] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:17 2022] GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:18.595159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:18.595770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:18.602465 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:18.602907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:18.603661 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:18.604089 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:18.737137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:18.745163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cc6a3374-1999-4bb7-a194-d8a759cfbb3b tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1680 microversion: 2.1 time: 0.155191 Jul 12 14:39:18.745772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 391/795] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:18 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:18.914255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8f2202a3-86dd-4845-a949-d4bdab03cca5 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d32365e0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:18.942304 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-8f2202a3-86dd-4845-a949-d4bdab03cca5 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] HTTP exception thrown: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8f2202a3-86dd-4845-a949-d4bdab03cca5 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Request method failure captured: Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 HTTP/1.1 Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYePLBtdOnuBCYtmGQaUFDlgHaXTiugxyT66SZDm5ahCoHWKKiP_NqL9_RI9f1FT30qcNPYWkx6xRBMna7Nr1yaangtt9wl3GRfK1n08CkOzJbs2VFnZYJ5zDcaD9nh9B0z0kXwz29iodNa0P9N7XJZiyaeQoTU64GjmZyxGTe3W90k Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:18.944377 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/decc10c5e64842e38d528c832429351c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_decc10c5e64842e38d528c832429351c", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 8329adf3b3b14eb488f0473e2b61e48b Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3'} Jul 12 14:39:18.945936 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. (HTTP 404) (Request-ID: req-0005240d-9a48-480d-b008-d8904fb772d8) Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.946885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:18.948284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:18.949667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8f2202a3-86dd-4845-a949-d4bdab03cca5 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Returning 404 to user: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8f2202a3-86dd-4845-a949-d4bdab03cca5 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 404 len: 109 microversion: 2.1 time: 0.036469 Jul 12 14:39:18.951066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 405/796] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:18 2022] GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:18.959654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71b45754-0288-4071-a758-791ca064f629 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01ce9591f0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:18.987249 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-71b45754-0288-4071-a758-791ca064f629 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] HTTP exception thrown: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71b45754-0288-4071-a758-791ca064f629 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Request method failure captured: Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: DELETE /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 HTTP/1.1 Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYePLBtdOnuBCYtmGQaUFDlgHaXTiugxyT66SZDm5ahCoHWKKiP_NqL9_RI9f1FT30qcNPYWkx6xRBMna7Nr1yaangtt9wl3GRfK1n08CkOzJbs2VFnZYJ5zDcaD9nh9B0z0kXwz29iodNa0P9N7XJZiyaeQoTU64GjmZyxGTe3W90k Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:18.990614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/decc10c5e64842e38d528c832429351c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_decc10c5e64842e38d528c832429351c", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 8329adf3b3b14eb488f0473e2b61e48b Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3'} Jul 12 14:39:18.992630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. (HTTP 404) (Request-ID: req-aa38a9e2-48de-46f7-9696-bb5049c9b7d9) Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.993531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 14:39:18.994843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 14:39:18.996229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71b45754-0288-4071-a758-791ca064f629 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Returning 404 to user: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-71b45754-0288-4071-a758-791ca064f629 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 404 len: 109 microversion: 2.1 time: 0.036848 Jul 12 14:39:18.997677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 392/797] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:18 2022] DELETE /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:19.001050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fdf1cf72-4bf7-49aa-be46-a43290d9f746 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Calling method '.version_select at 0x7f01d3237f70>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:19.031831 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-fdf1cf72-4bf7-49aa-be46-a43290d9f746 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] HTTP exception thrown: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fdf1cf72-4bf7-49aa-be46-a43290d9f746 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Request method failure captured: Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 HTTP/1.1 Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYePLBtdOnuBCYtmGQaUFDlgHaXTiugxyT66SZDm5ahCoHWKKiP_NqL9_RI9f1FT30qcNPYWkx6xRBMna7Nr1yaangtt9wl3GRfK1n08CkOzJbs2VFnZYJ5zDcaD9nh9B0z0kXwz29iodNa0P9N7XJZiyaeQoTU64GjmZyxGTe3W90k Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:19.033798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/decc10c5e64842e38d528c832429351c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/decc10c5e64842e38d528c832429351c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_decc10c5e64842e38d528c832429351c", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: decc10c5e64842e38d528c832429351c Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895954917 Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 8329adf3b3b14eb488f0473e2b61e48b Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895954917-project Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3'} Jul 12 14:39:19.035348 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. (HTTP 404) (Request-ID: req-ef72a271-bdf5-4966-83a4-d86a0e8e2e53) Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:19.036271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:19.038136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:19.039506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fdf1cf72-4bf7-49aa-be46-a43290d9f746 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] Returning 404 to user: Volume 546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fdf1cf72-4bf7-49aa-be46-a43290d9f746 tempest-VolumesSnapshotsTestJSON-1895954917 tempest-VolumesSnapshotsTestJSON-1895954917-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3" status: 404 len: 109 microversion: 2.1 time: 0.037916 Jul 12 14:39:19.040794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 406/798] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:18 2022] GET /compute/v2.1/os-volumes/546154bb-ffe7-4dc8-b5fc-cedfd1e9c6f3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:19.763437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:19.767588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:19.775049 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:19.775721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:19.776555 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:19.777072 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:20.056838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:20.065486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b04e0991-84d1-4eea-83b3-94cb3a8874f3 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1680 microversion: 2.1 time: 0.306190 Jul 12 14:39:20.066164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 393/799] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:19 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1680 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:20.592979 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-651420a3-8705-4218-bfde-15c933f8e27b req-af9dacac-2aee-46f8-a6a0-64fb63edb6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2e928a-5e26-4720-ac84-a3d5d46ae967", "name": "network-vif-deleted", "tag": "1f56d104-48b0-4f02-a8f2-28aec80164bf"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:20.608618 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-651420a3-8705-4218-bfde-15c933f8e27b req-af9dacac-2aee-46f8-a6a0-64fb63edb6a2 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:20.609152 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-651420a3-8705-4218-bfde-15c933f8e27b req-af9dacac-2aee-46f8-a6a0-64fb63edb6a2 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:20.620244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-651420a3-8705-4218-bfde-15c933f8e27b req-af9dacac-2aee-46f8-a6a0-64fb63edb6a2 service nova] Creating event network-vif-deleted:1f56d104-48b0-4f02-a8f2-28aec80164bf for instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 on hv-cinder-83699 Jul 12 14:39:20.626039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-651420a3-8705-4218-bfde-15c933f8e27b req-af9dacac-2aee-46f8-a6a0-64fb63edb6a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043508 Jul 12 14:39:20.626844 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 407/800] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:21.082983 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:21.084223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:21.090730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:21.090958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:21.091974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:21.092631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:21.127185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:21.127860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:21.128528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lazy-loading 'fault' on Instance uuid eb2e928a-5e26-4720-ac84-a3d5d46ae967 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:39:21.179007 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b22129ca8c714db6ad44dee94e6099e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb73ce3627964df4a085d7d9a81a9f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:21.189238 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7c10a904-2c4f-4a9b-9482-86479243e836 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 200 len: 1331 microversion: 2.1 time: 0.110320 Jul 12 14:39:21.192284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 394/801] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:21 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:22.209921 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:22.210678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:22.218461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:22.218912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:22.219683 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:22.220109 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:22.234317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 HTTP/1.1 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:22.236078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:22.237847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'eb2e928a-5e26-4720-ac84-a3d5d46ae967'} Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:22.238830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:22.240161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:22.241563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:22.241563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4f01c063-3e89-469b-b6f3-1a0b3288e71c tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 404 len: 111 microversion: 2.1 time: 0.033383 Jul 12 14:39:22.241563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 408/802] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:22 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:22.246437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-74f22845-6f86-41d7-8d62-ea24ce41de26 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '.version_select at 0x7f01ce8f38b0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:22.265186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-74f22845-6f86-41d7-8d62-ea24ce41de26 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729341348" status: 202 len: 0 microversion: 2.1 time: 0.022496 Jul 12 14:39:22.265800 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 395/803] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 14:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729341348 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:24.091345 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:24.092041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:24.098594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:24.099048 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:24.100327 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:24.100769 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:24.114567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 HTTP/1.1 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:24.116670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.118233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'eb2e928a-5e26-4720-ac84-a3d5d46ae967'} Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:24.119207 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.120774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.122493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:24.122493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e5b1e007-7641-4040-b2c0-6c854fac21fa tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jul 12 14:39:24.122493 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 409/804] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:24 2022] DELETE /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:24.128239 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:24.128850 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: eb2e928a-5e26-4720-ac84-a3d5d46ae967] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:24.138112 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:24.138562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:24.139327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:24.139760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:24.159107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 HTTP/1.1 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:24.160669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.162057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'eb2e928a-5e26-4720-ac84-a3d5d46ae967'} Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:24.163362 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. Jul 12 14:39:24.164732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:24.168186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance eb2e928a-5e26-4720-ac84-a3d5d46ae967 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:24.168186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-556159be-9ba6-496e-a7fb-cb404b7b8625 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967" status: 404 len: 111 microversion: 2.1 time: 0.039844 Jul 12 14:39:24.168186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 396/805] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:24 2022] GET /compute/v2.1/servers/eb2e928a-5e26-4720-ac84-a3d5d46ae967 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:25.305143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:25.305678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:25.312105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.312542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.313579 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.314008 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.327028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf HTTP/1.1 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:25.328515 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.330260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '90d33678-1a9f-4331-8d26-8393eb80bcdf'} Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:25.331154 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.332697 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.334682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:25.334682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ea9ea3c1-d889-46ab-a9a8-c68db56dabe4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 404 len: 111 microversion: 2.1 time: 0.028792 Jul 12 14:39:25.334682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 410/806] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:25 2022] DELETE /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:25.339383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:25.340321 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: 90d33678-1a9f-4331-8d26-8393eb80bcdf] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:25.347557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.348003 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.348791 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.349226 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.362900 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf HTTP/1.1 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:25.364408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.366042 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '90d33678-1a9f-4331-8d26-8393eb80bcdf'} Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:25.366839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. Jul 12 14:39:25.368087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.369186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance 90d33678-1a9f-4331-8d26-8393eb80bcdf could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:25.369186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0e4f0ac1-8316-4d1e-9d93-6c2416bccdfb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf" status: 404 len: 111 microversion: 2.1 time: 0.030772 Jul 12 14:39:25.369186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 397/807] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:25 2022] GET /compute/v2.1/servers/90d33678-1a9f-4331-8d26-8393eb80bcdf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:25.374223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:25.374718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:25.380650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.381105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.382324 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.382981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.397302 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 HTTP/1.1 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:25.399452 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.400974 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'e5009617-7468-48d8-81b6-718b0dbd1161'} Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:25.401922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.403434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.405143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:25.405143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-499cdb62-398c-485c-8d47-023b1b39fdf4 tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 404 len: 111 microversion: 2.1 time: 0.030386 Jul 12 14:39:25.405143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 411/808] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:25 2022] DELETE /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:25.409185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:25.409829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: e5009617-7468-48d8-81b6-718b0dbd1161] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:25.416543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.416991 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.417788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:25.418228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:25.431387 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 HTTP/1.1 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:25.432958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.434674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'e5009617-7468-48d8-81b6-718b0dbd1161'} Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:25.435448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. Jul 12 14:39:25.436749 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:25.440799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance e5009617-7468-48d8-81b6-718b0dbd1161 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:25.440799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4faff62e-77fa-408e-b9e6-e7de8e51e8cb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161" status: 404 len: 111 microversion: 2.1 time: 0.029078 Jul 12 14:39:25.440799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 398/809] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:25 2022] GET /compute/v2.1/servers/e5009617-7468-48d8-81b6-718b0dbd1161 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:26.577912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:26.578406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:26.586038 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:26.586485 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:26.587245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:26.587680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:26.601373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 HTTP/1.1 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:26.602875 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.604743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'a632d5e0-9cae-4a5d-9607-4b8f91601de6'} Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:26.605642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.607131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.608600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:26.608600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3ef80758-7696-4275-9911-93f9e81ad19d tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 404 len: 111 microversion: 2.1 time: 0.030134 Jul 12 14:39:26.608600 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 412/810] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:26 2022] DELETE /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:26.612597 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:26.613215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] [instance: a632d5e0-9cae-4a5d-9607-4b8f91601de6] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:26.619557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:26.620009 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:26.620772 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:26.621213 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:26.634932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] HTTP exception thrown: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Request method failure captured: Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 HTTP/1.1 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYX8pG4AYZ0bkEt3VTJKsibgxuBO2wCCRFT44XWY_qQ3Qr19N8MS7wU4rEWX24XdHMFOhLeL8SdaEJ0WpspejE9jJ5exFGQ9mcyKa6GDEKyF2yh8g8ozl2RtzDD3xbUKg79VXnSUDGSi34Qr8aEuaX2Ec3tUR3G-tIX4Q0TXcUGqlFM Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:39:26.636467 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb73ce3627964df4a085d7d9a81a9f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb73ce3627964df4a085d7d9a81a9f59", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: eb73ce3627964df4a085d7d9a81a9f59 Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1120100695 Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: b22129ca8c714db6ad44dee94e6099e9 Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeNegativeTest-1120100695-project Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.638068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'a632d5e0-9cae-4a5d-9607-4b8f91601de6'} Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:26.639137 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. Jul 12 14:39:26.640588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:39:26.641922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] Returning 404 to user: Instance a632d5e0-9cae-4a5d-9607-4b8f91601de6 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:26.641922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bc18e4ec-04cd-42f8-be9c-ec123e6451eb tempest-AttachVolumeNegativeTest-1120100695 tempest-AttachVolumeNegativeTest-1120100695-project] 10.222.0.25 "GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6" status: 404 len: 111 microversion: 2.1 time: 0.029147 Jul 12 14:39:26.641922 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 399/811] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:26 2022] GET /compute/v2.1/servers/a632d5e0-9cae-4a5d-9607-4b8f91601de6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:39:31.696459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a7d1dec6-aaf7-4566-976b-ba9f41a79cdc tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Action: 'create', calling method: .version_select at 0x7f01d3166310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1450400064", "metadata": {"Type": "work"}}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:31.997802 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a7d1dec6-aaf7-4566-976b-ba9f41a79cdc tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.429489 Jul 12 14:39:31.998686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 413/812] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Jul 12 14:39:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 14:39:32.010148 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-aca8bdb0-f159-4837-b495-a03787b1d7cb tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01ce8f3ee0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:32.071350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-aca8bdb0-f159-4837-b495-a03787b1d7cb tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 200 len: 353 microversion: 2.1 time: 0.065755 Jul 12 14:39:32.072025 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 400/813] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:32 2022] GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:33.084273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-81afc0ea-e93f-44c2-ae54-0a93dc8ef10b tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01d31670d0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.134655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-81afc0ea-e93f-44c2-ae54-0a93dc8ef10b tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 200 len: 354 microversion: 2.1 time: 0.054630 Jul 12 14:39:33.135425 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 414/814] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:33 2022] GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:33.146294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-49bfa339-dbc8-446f-b766-ef752ed6e55b tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01cea06160>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.196027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-49bfa339-dbc8-446f-b766-ef752ed6e55b tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 200 len: 354 microversion: 2.1 time: 0.053313 Jul 12 14:39:33.196595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 401/815] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:33 2022] GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:33.212963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01b8eef6-d088-4e98-879c-2691b90c9ac4 tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01d3166dc0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.274089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01b8eef6-d088-4e98-879c-2691b90c9ac4 tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 202 len: 0 microversion: 2.1 time: 0.065361 Jul 12 14:39:33.274653 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 415/816] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:39:33 2022] DELETE /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:39:33.282677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-eae3014d-01ac-4c52-a24f-d2f2f49db5e6 tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01ce912310>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:33.334474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-eae3014d-01ac-4c52-a24f-d2f2f49db5e6 tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 200 len: 353 microversion: 2.1 time: 0.055321 Jul 12 14:39:33.335091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 402/817] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:33 2022] GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:34.347726 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47ad2b4c-d0c6-4f24-9f4d-bf3e2e8d485a tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Calling method '.version_select at 0x7f01caa44ee0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:34.376059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-47ad2b4c-d0c6-4f24-9f4d-bf3e2e8d485a tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] HTTP exception thrown: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47ad2b4c-d0c6-4f24-9f4d-bf3e2e8d485a tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Request method failure captured: Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b HTTP/1.1 Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYejyydPrQuy5Qn1cJpLaB8rvaAX6FRfGrzBaZeTEgtQAfxjOBsvzm-2nVfWVy_egqVknMUZftPEG9bb2B8P1e0BRoN2rvbNCMd455Dmr9CXUHbipYW8Lwa3vCinWQT-iGfGQdGSW1URFB7sNgxWMXKdT2yeM1GzcDXJCp0FF7AARpQ Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 70424b4a998a46a0a9e70d76e0d4e36d Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesGetTestJSON-624511031 Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:34.378028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70424b4a998a46a0a9e70d76e0d4e36d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/70424b4a998a46a0a9e70d76e0d4e36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/70424b4a998a46a0a9e70d76e0d4e36d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_70424b4a998a46a0a9e70d76e0d4e36d", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesGetTestJSON-624511031 Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 70424b4a998a46a0a9e70d76e0d4e36d Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesGetTestJSON-624511031 Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesGetTestJSON-624511031-project Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 467530cfb4c8434c88c705f81dc7f845 Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesGetTestJSON-624511031-project Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '6f1cbd07-5e71-44f1-84c0-f43bda838b5b'} Jul 12 14:39:34.379733 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. (HTTP 404) (Request-ID: req-da43e0e1-6f16-406b-87f5-a2dc7a743ec2) Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:34.381473 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 14:39:34.382939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 14:39:34.384576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-47ad2b4c-d0c6-4f24-9f4d-bf3e2e8d485a tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] Returning 404 to user: Volume 6f1cbd07-5e71-44f1-84c0-f43bda838b5b could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-47ad2b4c-d0c6-4f24-9f4d-bf3e2e8d485a tempest-VolumesGetTestJSON-624511031 tempest-VolumesGetTestJSON-624511031-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b" status: 404 len: 109 microversion: 2.1 time: 0.036155 Jul 12 14:39:34.386024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 416/818] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Jul 12 14:39:34 2022] GET /compute/v2.1/os-volumes/6f1cbd07-5e71-44f1-84c0-f43bda838b5b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:40.524832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:40.525631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=55 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:40.529528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-840560089", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "networks": [{"uuid": "8013be3f-a761-4d1a-97ea-01f14e9dd283"}]}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:40.587415 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] validate_networks() for [('8013be3f-a761-4d1a-97ea-01f14e9dd283', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:41.048957 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:41.049439 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:41.049918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:41.050506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:41.051153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:41.064172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.064633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.065475 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:41.065918 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:41.083670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Getting quotas for project f8ff4496a9884d6ba5f53803d4aa475b. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:41.087613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Getting quotas for user 294ef0f0e5e04c4193eba83a679afed1 and project f8ff4496a9884d6ba5f53803d4aa475b. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:41.098732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:41.101010 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:41.145498 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-88ba2db3-0a33-4be1-a008-201a34c9cbfc tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621780 Jul 12 14:39:41.146148 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 403/819] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:41.155176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:41.155988 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:41.160172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d8c3a04-c623-41f8-abe5-e82865f91db2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:41.160810 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4d8c3a04-c623-41f8-abe5-e82865f91db2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:41.232101 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4d8c3a04-c623-41f8-abe5-e82865f91db2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:41.239747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4d8c3a04-c623-41f8-abe5-e82865f91db2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1213 microversion: 2.1 time: 0.086473 Jul 12 14:39:41.240344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 417/820] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:41 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:42.262269 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:42.263584 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:42.270653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.271453 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.272421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:42.273048 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:42.389402 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:42.400064 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9cf845e4-25f0-43c6-82aa-c2edab0853c3 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1283 microversion: 2.1 time: 0.145152 Jul 12 14:39:42.400643 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 404/821] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:42 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:43.416887 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:43.418131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:43.424928 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.425396 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.426164 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.426595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.569292 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:43.577400 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2b0d62ab-7d79-4cfb-99bf-acf58a197197 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1313 microversion: 2.1 time: 0.164477 Jul 12 14:39:43.578284 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 418/822] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:43 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:43.606263 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-d75088ad-7984-4f7c-a20a-42fea03eb402 req-bdf9b762-0b74-4cf1-ab2c-9c4398bfdf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb495c58-bdcd-47e2-85a6-83eab7f0d559", "tag": "1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:43.619714 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d75088ad-7984-4f7c-a20a-42fea03eb402 req-bdf9b762-0b74-4cf1-ab2c-9c4398bfdf11 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:43.620268 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-d75088ad-7984-4f7c-a20a-42fea03eb402 req-bdf9b762-0b74-4cf1-ab2c-9c4398bfdf11 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:43.634361 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-d75088ad-7984-4f7c-a20a-42fea03eb402 req-bdf9b762-0b74-4cf1-ab2c-9c4398bfdf11 service nova] Creating event network-changed:1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a for instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 on hv-cinder-83699 Jul 12 14:39:43.639500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-d75088ad-7984-4f7c-a20a-42fea03eb402 req-bdf9b762-0b74-4cf1-ab2c-9c4398bfdf11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037800 Jul 12 14:39:43.640099 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 405/823] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:44.594900 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:44.595735 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:44.602897 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.603351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.604125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:44.604590 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:44.738620 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:44.746670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-040a69ba-2932-4287-8a66-123ebcb9e9e5 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1313 microversion: 2.1 time: 0.155589 Jul 12 14:39:44.747444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 419/824] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:44 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:45.764895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:45.765799 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:45.772472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.772916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.773718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:45.774156 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:45.910843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:45.919151 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-910ee381-d166-4f90-9f5f-71ff14a99180 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1313 microversion: 2.1 time: 0.158939 Jul 12 14:39:45.919721 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 406/825] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:45 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:46.937667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:46.938560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:46.945815 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.946276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:46.947144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:46.947586 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.082962 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:47.090991 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6caf0264-512e-4136-952c-9eaee2c7888d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1313 microversion: 2.1 time: 0.157414 Jul 12 14:39:47.091559 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 420/826] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:46 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:47.284628 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-09ffbb5f-45fc-485b-80b0-8534e322ccf8 req-4af591fd-ced0-4e32-928a-9ee6c609670f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb495c58-bdcd-47e2-85a6-83eab7f0d559", "name": "network-vif-plugged", "status": "completed", "tag": "1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:47.294171 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-09ffbb5f-45fc-485b-80b0-8534e322ccf8 req-4af591fd-ced0-4e32-928a-9ee6c609670f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:47.294589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-09ffbb5f-45fc-485b-80b0-8534e322ccf8 req-4af591fd-ced0-4e32-928a-9ee6c609670f service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:47.308912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-09ffbb5f-45fc-485b-80b0-8534e322ccf8 req-4af591fd-ced0-4e32-928a-9ee6c609670f service nova] Creating event network-vif-plugged:1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a for instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 on hv-cinder-83699 Jul 12 14:39:47.314841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-09ffbb5f-45fc-485b-80b0-8534e322ccf8 req-4af591fd-ced0-4e32-928a-9ee6c609670f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Jul 12 14:39:47.315466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 407/827] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:48.108517 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:48.109125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:48.116315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.116761 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.117556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:48.117988 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:48.246090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:48.253628 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-43b36c68-f7ba-4050-89fa-d739f4e97f76 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1313 microversion: 2.1 time: 0.148916 Jul 12 14:39:48.254187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 421/828] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:48 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:49.271767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:49.272489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:49.278936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.279477 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.280261 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.280692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.410666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:49.418737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ffe146fa-8cf9-4053-bede-ec4514809d4d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1497 microversion: 2.1 time: 0.151198 Jul 12 14:39:49.418877 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 408/829] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:49 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:49.926559 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:49.927060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:49.934155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.934552 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.935336 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:49.935916 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:49.961027 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:39:50.047241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebad4cd7-5bf5-4d2a-a756-3b0af15cf7bb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 204 len: 0 microversion: 2.1 time: 0.123714 Jul 12 14:39:50.048443 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 422/830] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:39:49 2022] DELETE /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:39:50.057560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:50.058193 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:50.064445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:50.064901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:50.065687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:50.066123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:50.207337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:50.215491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e390e378-1483-4241-85ac-bfdddcd0f3ad tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1503 microversion: 2.1 time: 0.162000 Jul 12 14:39:50.216048 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 409/831] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:50 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:51.233687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:51.234961 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:51.237314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:51.244518 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.245796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.246928 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:51.247367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:51.390435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:51.398498 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3d417222-f6e0-466c-9c0b-e42c33d4d603 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1503 microversion: 2.1 time: 0.168970 Jul 12 14:39:51.399070 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 423/832] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:51 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:52.063805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.064738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.068529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:52.069675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:52.075707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.076173 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.076955 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.077421 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.108525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-53aaea48-af48-4e2d-9ab6-a01d63f78a86 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048935 Jul 12 14:39:52.109397 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 410/833] 10.222.0.25 () {60 vars in 1342 bytes} [Tue Jul 12 14:39:52 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:52.177982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.178531 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.187282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-2d2e4960-f5ad-4c98-81c4-943730f88eaf req-1c083c13-ea0f-460e-aa09-ff791e9face0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb495c58-bdcd-47e2-85a6-83eab7f0d559", "name": "network-vif-deleted", "tag": "1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:52.191592 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.192444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.193474 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.194556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.197933 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2d2e4960-f5ad-4c98-81c4-943730f88eaf req-1c083c13-ea0f-460e-aa09-ff791e9face0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.198608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2d2e4960-f5ad-4c98-81c4-943730f88eaf req-1c083c13-ea0f-460e-aa09-ff791e9face0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.214760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-2d2e4960-f5ad-4c98-81c4-943730f88eaf req-1c083c13-ea0f-460e-aa09-ff791e9face0 service nova] Creating event network-vif-deleted:1d7a3263-72b3-4118-8e5f-ccfa5d8fab9a for instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 on hv-cinder-83699 Jul 12 14:39:52.220244 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-2d2e4960-f5ad-4c98-81c4-943730f88eaf req-1c083c13-ea0f-460e-aa09-ff791e9face0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036624 Jul 12 14:39:52.222054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 411/834] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:39:52.234702 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:39:52.323278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3edf3027-7ff0-4185-b822-601fd1b301b0 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 204 len: 0 microversion: 2.20 time: 0.150381 Jul 12 14:39:52.324311 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 424/835] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 14:39:52 2022] DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:39:52.333188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.334399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.341257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.341750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.342626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.343337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.417107 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:52.417765 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:52.424692 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.425224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.426116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.426631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.460651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:52.461103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:52.461808 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lazy-loading 'fault' on Instance uuid eb495c58-bdcd-47e2-85a6-83eab7f0d559 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:39:52.489108 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.498581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.500124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.501284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4a228103-fbcf-4f6b-be2c-96edf007b8a2 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.172465 Jul 12 14:39:52.501874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 412/836] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:52 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:52.513915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:52.521657 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-54b49ef0-df42-41d2-96c4-5d00e81a7d49 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1303 microversion: 2.1 time: 0.109144 Jul 12 14:39:52.522204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 425/837] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:52 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:53.520342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:53.521696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:53.528410 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.528848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.529718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.530163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.539420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:53.540012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:53.546776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.547225 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.548252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.548673 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.581042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:53.581527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:53.582345 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lazy-loading 'fault' on Instance uuid eb495c58-bdcd-47e2-85a6-83eab7f0d559 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:39:53.629309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:53.638896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5920f29c-ca48-42d3-8c86-f940218d3190 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 200 len: 1303 microversion: 2.1 time: 0.103159 Jul 12 14:39:53.649031 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 426/838] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:53 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:39:53.689768 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:53.698666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:53.700176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:53.701361 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6e8fef8f-f6ee-4aa4-bfa9-a6fb86b10294 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1723 microversion: 2.20 time: 0.185308 Jul 12 14:39:53.701926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 413/839] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:53 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 14:39:54.656125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:54.657450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: eb495c58-bdcd-47e2-85a6-83eab7f0d559] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:54.666285 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.666735 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.667642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.668078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.682095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] HTTP exception thrown: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Request method failure captured: Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 HTTP/1.1 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYeqz84YYZIw7FdL_FwpFecxopKmjCiKTvaRAGRUE15OXfO_Tx0qKF-C4K80j1JWovai27cQONZ43dfdedKdKFfsehC4cg88uxsswoKckc6cGm33ANqXvFim7jFcWwAn0PVRbI_JWu_kb9CBhIuwl10J216D0U3uHK61Q_5yxlJe9U4 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: f8ff4496a9884d6ba5f53803d4aa475b Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesActionsTest-1738275594 Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:54.683771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8ff4496a9884d6ba5f53803d4aa475b", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesActionsTest-1738275594 Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: f8ff4496a9884d6ba5f53803d4aa475b Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesActionsTest-1738275594 Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesActionsTest-1738275594-project Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 294ef0f0e5e04c4193eba83a679afed1 Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesActionsTest-1738275594-project Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. Jul 12 14:39:54.685520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'eb495c58-bdcd-47e2-85a6-83eab7f0d559'} Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:54.687144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. Jul 12 14:39:54.693076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:54.696282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Returning 404 to user: Instance eb495c58-bdcd-47e2-85a6-83eab7f0d559 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:54.696282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2617baa6-0a51-42c4-98d3-b7cca874f119 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559" status: 404 len: 111 microversion: 2.1 time: 0.033044 Jul 12 14:39:54.696282 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 427/840] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:54 2022] GET /compute/v2.1/servers/eb495c58-bdcd-47e2-85a6-83eab7f0d559 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:39:54.723399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:54.724128 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:54.733847 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.734191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.735026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.735713 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.833206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-167550542", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "networks": [{"uuid": "8013be3f-a761-4d1a-97ea-01f14e9dd283"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:54.844264 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.864310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.869747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3753498f22d5443ab0c01473c91a263c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7122215625b64963ab03b66f4c9d8a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:54.871224 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-17527311-fed9-4196-946b-6314a7f31b55 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 200 len: 1655 microversion: 2.20 time: 0.154543 Jul 12 14:39:54.871875 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 414/841] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:54 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 14:39:54.894080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-a03e7194-315c-49da-9a3b-795d9a7c01af req-6414e37e-a8ce-4cd1-a4da-e82700bef616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cba68e-29aa-4287-ad43-50abd844dd13", "name": "network-vif-deleted", "tag": "0c6f1471-27d5-408b-8806-48b049ebb7ae"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:54.904876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a03e7194-315c-49da-9a3b-795d9a7c01af req-6414e37e-a8ce-4cd1-a4da-e82700bef616 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:54.905413 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a03e7194-315c-49da-9a3b-795d9a7c01af req-6414e37e-a8ce-4cd1-a4da-e82700bef616 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:54.924296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] validate_networks() for [('8013be3f-a761-4d1a-97ea-01f14e9dd283', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:39:54.936146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-a03e7194-315c-49da-9a3b-795d9a7c01af req-6414e37e-a8ce-4cd1-a4da-e82700bef616 service nova] Creating event network-vif-deleted:0c6f1471-27d5-408b-8806-48b049ebb7ae for instance c3cba68e-29aa-4287-ad43-50abd844dd13 on hv-cinder-83699 Jul 12 14:39:54.946587 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-a03e7194-315c-49da-9a3b-795d9a7c01af req-6414e37e-a8ce-4cd1-a4da-e82700bef616 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056500 Jul 12 14:39:54.947597 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 415/842] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:55.440394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:39:55.441005 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:39:55.441670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:39:55.442236 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:39:55.442853 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:39:55.453908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.454549 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.456405 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.457043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.481110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Getting quotas for project f8ff4496a9884d6ba5f53803d4aa475b. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:39:55.488033 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Getting quotas for user 294ef0f0e5e04c4193eba83a679afed1 and project f8ff4496a9884d6ba5f53803d4aa475b. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:39:55.503821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:39:55.506601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:39:55.559006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a47b73a6-a826-4bc9-99e7-4fe2ac8b0a1d tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731174 Jul 12 14:39:55.560688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 428/843] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:39:55.571846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-40c12b70-a47c-417f-b874-0111a24a1014 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:55.572626 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-40c12b70-a47c-417f-b874-0111a24a1014 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:55.642463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-40c12b70-a47c-417f-b874-0111a24a1014 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:55.649781 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-40c12b70-a47c-417f-b874-0111a24a1014 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1213 microversion: 2.1 time: 0.082437 Jul 12 14:39:55.650864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 416/844] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:55 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:55.903821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:55.904435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:55.912398 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.912855 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.913938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:55.914658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:55.932116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 HTTP/1.1 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:55.933794 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:55.935882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'c3cba68e-29aa-4287-ad43-50abd844dd13'} Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:55.937233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:55.939553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:55.941170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:55.941170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-01c7b7dc-cb62-4da9-abed-6f5c4f376c6c tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 404 len: 111 microversion: 2.20 time: 0.035844 Jul 12 14:39:55.941170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 429/845] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:55 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:39:55.945292 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-94e8630d-5209-463d-983e-ecb7545e7fb6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '.version_select at 0x7f01cea06ee0>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:55.972724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-94e8630d-5209-463d-983e-ecb7545e7fb6 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558620975" status: 204 len: 0 microversion: 2.20 time: 0.031349 Jul 12 14:39:55.973398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 417/846] 10.222.0.25 () {60 vars in 1261 bytes} [Tue Jul 12 14:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558620975 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 14:39:56.668209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:56.669238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:56.680492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.681244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.682451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:56.683065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:56.886864 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:56.896363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d057d789-6879-46c3-b3bf-69fb21165664 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1283 microversion: 2.1 time: 0.233102 Jul 12 14:39:56.897295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 430/847] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:56 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:57.917061 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:57.918865 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:57.928461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.929028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:57.930192 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:57.930974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.075594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:58.076099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:58.082270 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.082721 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.084050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.084497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.098041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 HTTP/1.1 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:58.099627 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.101367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'c3cba68e-29aa-4287-ad43-50abd844dd13'} Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:58.102197 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.103624 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.105643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:58.105643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-75f5218b-537c-455f-930d-00065bdc126b tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 404 len: 111 microversion: 2.20 time: 0.029576 Jul 12 14:39:58.105643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 431/848] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 14:39:58 2022] DELETE /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:39:58.110860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:58.111562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: c3cba68e-29aa-4287-ad43-50abd844dd13] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:58.117772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.118215 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.119058 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.119497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.133325 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 HTTP/1.1 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:58.134956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.136652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': 'c3cba68e-29aa-4287-ad43-50abd844dd13'} Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:58.137520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. Jul 12 14:39:58.138740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:58.139865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance c3cba68e-29aa-4287-ad43-50abd844dd13 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:58.139865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ee614622-b9ff-4a04-aaa0-0375bc324718 tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13" status: 404 len: 111 microversion: 2.20 time: 0.030009 Jul 12 14:39:58.139865 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 432/849] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:58 2022] GET /compute/v2.1/servers/c3cba68e-29aa-4287-ad43-50abd844dd13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 14:39:58.176667 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:58.188678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d9e63b82-0295-4314-9440-5b0a90148c88 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.277643 Jul 12 14:39:58.197543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 418/850] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:57 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:39:58.397554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-e6cb0450-a30d-4396-ae37-21cd295ceaaf req-672c9e8a-019b-4259-9524-6d031baf553e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd9a7d7-6b32-44ce-a357-2e6dfee707dd", "tag": "0cb92bbb-62aa-466a-8ff6-a86e4ff130f8"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:39:58.409827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e6cb0450-a30d-4396-ae37-21cd295ceaaf req-672c9e8a-019b-4259-9524-6d031baf553e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:58.410550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e6cb0450-a30d-4396-ae37-21cd295ceaaf req-672c9e8a-019b-4259-9524-6d031baf553e service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:58.422710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-e6cb0450-a30d-4396-ae37-21cd295ceaaf req-672c9e8a-019b-4259-9524-6d031baf553e service nova] Creating event network-changed:0cb92bbb-62aa-466a-8ff6-a86e4ff130f8 for instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd on hv-cinder-83699 Jul 12 14:39:58.428030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-e6cb0450-a30d-4396-ae37-21cd295ceaaf req-672c9e8a-019b-4259-9524-6d031baf553e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033955 Jul 12 14:39:58.428611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 433/851] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:39:59.206416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:59.207060 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:59.214100 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.214550 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.215311 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.215744 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.294504 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:59.295116 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:59.302736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.303224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.304065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.304551 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.320317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 HTTP/1.1 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:59.322105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.323555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '99794eb0-cb27-44f8-8d77-3ab2377fb8b6'} Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:59.324349 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.325589 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.327778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:59.327778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f3427534-b95c-4a50-998f-67c2e5eeb97e tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 404 len: 111 microversion: 2.20 time: 0.033818 Jul 12 14:39:59.327778 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 434/852] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Jul 12 14:39:59 2022] DELETE /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:39:59.331671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:39:59.332276 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] [instance: 99794eb0-cb27-44f8-8d77-3ab2377fb8b6] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:39:59.338318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.338768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.339535 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:39:59.339968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:39:59.344068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:59.355369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] HTTP exception thrown: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Request method failure captured: Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 HTTP/1.1 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYYGtotgKrivSJrFc0Lc2exHnodCh-byaQNA92HF3WArmJR1IsnhCJjYwwyKPr56PZok3Y0AXZO4m2CSzVb10uIJXOxfDmR4b3tDaqQrer8gRrPj7Kw7l2aOqYN0joJZ0SrWf4PhPuBd40Wk9Er4sGM3WRugtoN6mn7KY3GRRYmNk8o Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:39:59.357095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7122215625b64963ab03b66f4c9d8a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7122215625b64963ab03b66f4c9d8a7f", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 7122215625b64963ab03b66f4c9d8a7f Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1661735047 Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 3753498f22d5443ab0c01473c91a263c Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1661735047-project Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.358832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '99794eb0-cb27-44f8-8d77-3ab2377fb8b6'} Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:39:59.359676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. Jul 12 14:39:59.361227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:39:59.362560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:39:59.362671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] Returning 404 to user: Instance 99794eb0-cb27-44f8-8d77-3ab2377fb8b6 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:39:59.362671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cee9c187-af25-48aa-bd73-544c2181a5cb tempest-AttachVolumeShelveTestJSON-1661735047 tempest-AttachVolumeShelveTestJSON-1661735047-project] 10.222.0.25 "GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6" status: 404 len: 111 microversion: 2.20 time: 0.030517 Jul 12 14:39:59.362671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 435/853] 10.222.0.25 () {60 vars in 1276 bytes} [Tue Jul 12 14:39:59 2022] GET /compute/v2.1/servers/99794eb0-cb27-44f8-8d77-3ab2377fb8b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 14:39:59.369447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e7254f60-dc42-4b2e-a803-9df6190027c6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.167470 Jul 12 14:39:59.370104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 419/854] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:39:59 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:00.387971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:00.388654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:00.403613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.404070 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.404859 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:00.405301 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:00.670340 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:00.679945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0af6f82d-571a-4c96-b960-247c8f414806 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.296378 Jul 12 14:40:00.680525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 436/855] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:00 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:01.189883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.190949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.196825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-50cf651d-bcd5-4499-8a8f-a331e4242799 req-d3eec8db-092c-4d7e-9aad-eb4d205759e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:01.209103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-50cf651d-bcd5-4499-8a8f-a331e4242799 req-d3eec8db-092c-4d7e-9aad-eb4d205759e1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.211756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.212432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.213416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.214082 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-50cf651d-bcd5-4499-8a8f-a331e4242799 req-d3eec8db-092c-4d7e-9aad-eb4d205759e1 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.217080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.248043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-50cf651d-bcd5-4499-8a8f-a331e4242799 req-d3eec8db-092c-4d7e-9aad-eb4d205759e1 service nova] Creating event network-changed:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:40:01.262465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-50cf651d-bcd5-4499-8a8f-a331e4242799 req-d3eec8db-092c-4d7e-9aad-eb4d205759e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069747 Jul 12 14:40:01.266822 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 437/856] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:01.276068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:40:01.403757 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-45ba48ea-23f2-46d0-a54e-a35474812f98 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 204 len: 0 microversion: 2.1 time: 0.218288 Jul 12 14:40:01.409713 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 420/857] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:40:01 2022] DELETE /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:40:01.416446 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.417748 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.425797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.426279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.427639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.428106 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.666929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:01.682786 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-694a7237-6bcd-4391-bd56-6296f51e0476 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.270883 Jul 12 14:40:01.701796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:01.702513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:01.709315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 438/858] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:01.713083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.713605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.714394 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:01.714976 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:01.899037 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:01.911296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9c2c53a7-22e7-4f69-b57e-bfd3295d26c2 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.216733 Jul 12 14:40:01.912491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 421/859] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:01 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:02.724813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:02.725471 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:02.732459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.732965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.733796 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.737419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.928743 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:02.931904 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:02.945659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.949401 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.953857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:02.954746 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:02.990585 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.005206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ebe3fd75-8c50-4653-9eb8-b59f724bf262 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.284896 Jul 12 14:40:03.005987 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 439/860] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:02 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:03.238801 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:03.252916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-71185272-fdaf-47e7-bcee-93b712dd0b6a tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.328511 Jul 12 14:40:03.269520 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 422/861] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:02 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:03.630837 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-93edaef6-1441-4bfd-9bfb-b5b4b0ce806a req-70730ee0-9926-4175-a008-ba911e744837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd9a7d7-6b32-44ce-a357-2e6dfee707dd", "name": "network-vif-plugged", "status": "completed", "tag": "0cb92bbb-62aa-466a-8ff6-a86e4ff130f8"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:03.646941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-93edaef6-1441-4bfd-9bfb-b5b4b0ce806a req-70730ee0-9926-4175-a008-ba911e744837 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:03.647593 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-93edaef6-1441-4bfd-9bfb-b5b4b0ce806a req-70730ee0-9926-4175-a008-ba911e744837 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:03.669641 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-93edaef6-1441-4bfd-9bfb-b5b4b0ce806a req-70730ee0-9926-4175-a008-ba911e744837 service nova] Creating event network-vif-plugged:0cb92bbb-62aa-466a-8ff6-a86e4ff130f8 for instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd on hv-cinder-83699 Jul 12 14:40:03.687523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-93edaef6-1441-4bfd-9bfb-b5b4b0ce806a req-70730ee0-9926-4175-a008-ba911e744837 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061353 Jul 12 14:40:03.689144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 440/862] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:04.031352 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:04.034175 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:04.043133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.044495 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.045565 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.046499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.052398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:04.284189 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:04.286110 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:04.304784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.305919 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.306838 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.307291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.326562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.336236 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ce2905bd-860a-41f0-a418-df94fdf34df1 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1570 microversion: 2.1 time: 0.313119 Jul 12 14:40:04.337395 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 423/863] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:04 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1570 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:04.457271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-12fa251d-8ec5-45db-a3cf-b1b722b63e5e req-d4f2c4d8-c272-4f0a-bb20-12ebef5543c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4", "name": "network-vif-deleted", "tag": "e03f8a0e-d77a-41e3-85a7-b3bc8891d99a"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:04.465632 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-12fa251d-8ec5-45db-a3cf-b1b722b63e5e req-d4f2c4d8-c272-4f0a-bb20-12ebef5543c9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:04.466080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-12fa251d-8ec5-45db-a3cf-b1b722b63e5e req-d4f2c4d8-c272-4f0a-bb20-12ebef5543c9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:04.477655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-12fa251d-8ec5-45db-a3cf-b1b722b63e5e req-d4f2c4d8-c272-4f0a-bb20-12ebef5543c9 service nova] Creating event network-vif-deleted:e03f8a0e-d77a-41e3-85a7-b3bc8891d99a for instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 on hv-cinder-83699 Jul 12 14:40:04.483381 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-12fa251d-8ec5-45db-a3cf-b1b722b63e5e req-d4f2c4d8-c272-4f0a-bb20-12ebef5543c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029665 Jul 12 14:40:04.483992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 424/864] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:40:04.545719 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:04.554256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-eb92b601-b7d3-456e-abba-f7d553001eb6 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1313 microversion: 2.1 time: 0.275704 Jul 12 14:40:04.554830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 441/865] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:04 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:05.356443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:05.357082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:05.363840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.364562 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.366150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.366573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.436308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d098bacbe444141b25a14d9d3d06cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82ac9fcca384f0793c21f7e06b234bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.444792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fd83b164-3c4e-43ee-8e9a-6fef9f243890 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 200 len: 1220 microversion: 2.1 time: 0.094379 Jul 12 14:40:05.455510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 425/866] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:05 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:05.572281 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:05.573595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:05.578543 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:05.579319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:05.585933 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.586809 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.589043 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:05.590000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:05.801160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:05.809557 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-7e7f6644-7a9d-4339-9abc-27ac87ef4e47 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1498 microversion: 2.1 time: 0.242450 Jul 12 14:40:05.822298 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 442/867] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:05 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:06.463058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.464683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] [instance: 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.468225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:06.474252 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.474706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.475531 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.476026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.498457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] HTTP exception thrown: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Request method failure captured: Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 HTTP/1.1 Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZnKv8m8Hp7jkKmUzqqXXmYx3gJTmiQWH9CL9fWpCMbFjvxbukw3_2gTw_4vkPB5qzKolmMcQOH2z5PVptuMOPd8GdLwN7wwqYu5i7fAYiiihadYg_zYaDPnMHTyYKzVGawpnw613vEpyCrZ7ZohejX3CdnIVad47KBJ4H7aIc7Tgw Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: c82ac9fcca384f0793c21f7e06b234bc Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-TestShelveInstance-1564172650 Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:40:06.500228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c82ac9fcca384f0793c21f7e06b234bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c82ac9fcca384f0793c21f7e06b234bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c82ac9fcca384f0793c21f7e06b234bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c82ac9fcca384f0793c21f7e06b234bc", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-TestShelveInstance-1564172650 Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: c82ac9fcca384f0793c21f7e06b234bc Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-TestShelveInstance-1564172650 Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-TestShelveInstance-1564172650-project Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 7d098bacbe444141b25a14d9d3d06cc1 Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-TestShelveInstance-1564172650-project Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. Jul 12 14:40:06.501736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4'} Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:40:06.502579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. Jul 12 14:40:06.503914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:06.505825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Returning 404 to user: Instance 9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:40:06.505825 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7ae05d33-0bd7-4638-9e93-f5c6c75aeaf0 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4" status: 404 len: 111 microversion: 2.1 time: 0.045596 Jul 12 14:40:06.509145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 426/868] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/9e3bdf8e-1bd2-40f1-b9aa-fb304a55cea4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:40:06.531971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.532678 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.539146 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.539671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.540505 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.541012 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.576295 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:40:06.658184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d7b6166a-bacd-4dd2-8101-6395dff188f7 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 204 len: 0 microversion: 2.1 time: 0.129850 Jul 12 14:40:06.659234 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 443/869] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:40:06 2022] DELETE /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:40:06.667903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.668516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:06.675206 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.675665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.676433 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:06.677468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:06.791970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d2f87620-a0b9-4665-95d9-e4702e296eb4 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] Calling method '.version_select at 0x7f01d31fa790>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:06.823785 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d2f87620-a0b9-4665-95d9-e4702e296eb4 tempest-TestShelveInstance-1564172650 tempest-TestShelveInstance-1564172650-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1575939642" status: 202 len: 0 microversion: 2.1 time: 0.037485 Jul 12 14:40:06.825893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 444/870] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Jul 12 14:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1575939642 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:40:06.925911 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:06.938882 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-486aca61-682a-4c0f-8bd5-77e44effa0de tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1504 microversion: 2.1 time: 0.274820 Jul 12 14:40:06.940977 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 427/871] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:06 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:07.957485 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:07.958743 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:07.968602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.969053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:07.969861 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:07.970294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:08.246688 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:08.264776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c3c532c0-be34-41c8-9d92-b024022ef924 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1504 microversion: 2.1 time: 0.310234 Jul 12 14:40:08.266767 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 445/872] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:07 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:09.283195 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:09.283769 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:09.300728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.301178 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.302104 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.311878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.789988 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294ef0f0e5e04c4193eba83a679afed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff4496a9884d6ba5f53803d4aa475b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:09.799472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1abbc60b-c7c0-4dcb-967b-113ed406fadb tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 200 len: 1462 microversion: 2.1 time: 0.520358 Jul 12 14:40:09.800219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 428/873] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:09 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 1462 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:09.834028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-4bac0ac7-febc-4a34-891b-699b0c145701 req-7cce32c6-6b6d-4434-a942-73772129b771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd9a7d7-6b32-44ce-a357-2e6dfee707dd", "name": "network-vif-deleted", "tag": "0cb92bbb-62aa-466a-8ff6-a86e4ff130f8"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:09.866128 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:09.888723 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4bac0ac7-febc-4a34-891b-699b0c145701 req-7cce32c6-6b6d-4434-a942-73772129b771 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:09.890140 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4bac0ac7-febc-4a34-891b-699b0c145701 req-7cce32c6-6b6d-4434-a942-73772129b771 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:09.920854 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-4bac0ac7-febc-4a34-891b-699b0c145701 req-7cce32c6-6b6d-4434-a942-73772129b771 service nova] Creating event network-vif-deleted:0cb92bbb-62aa-466a-8ff6-a86e4ff130f8 for instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd on hv-cinder-83699 Jul 12 14:40:09.932527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-4bac0ac7-febc-4a34-891b-699b0c145701 req-7cce32c6-6b6d-4434-a942-73772129b771 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107877 Jul 12 14:40:09.933476 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 446/874] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:10.819326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:10.820540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] [instance: ecd9a7d7-6b32-44ce-a357-2e6dfee707dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:10.834488 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:10.850443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.850892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.851671 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:10.852107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:10.883493 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] HTTP exception thrown: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Request method failure captured: Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd HTTP/1.1 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYeqz84YYZIw7FdL_FwpFecxopKmjCiKTvaRAGRUE15OXfO_Tx0qKF-C4K80j1JWovai27cQONZ43dfdedKdKFfsehC4cg88uxsswoKckc6cGm33ANqXvFim7jFcWwAn0PVRbI_JWu_kb9CBhIuwl10J216D0U3uHK61Q_5yxlJe9U4 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: f8ff4496a9884d6ba5f53803d4aa475b Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-VolumesActionsTest-1738275594 Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:40:10.884936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f8ff4496a9884d6ba5f53803d4aa475b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f8ff4496a9884d6ba5f53803d4aa475b", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-VolumesActionsTest-1738275594 Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: f8ff4496a9884d6ba5f53803d4aa475b Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-VolumesActionsTest-1738275594 Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-VolumesActionsTest-1738275594-project Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 294ef0f0e5e04c4193eba83a679afed1 Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-VolumesActionsTest-1738275594-project Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. Jul 12 14:40:10.886610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'ecd9a7d7-6b32-44ce-a357-2e6dfee707dd'} Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:40:10.887807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. Jul 12 14:40:10.889149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:40:10.892035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] Returning 404 to user: Instance ecd9a7d7-6b32-44ce-a357-2e6dfee707dd could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:40:10.892035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f4260347-28da-462a-a894-2e4dde4f8403 tempest-VolumesActionsTest-1738275594 tempest-VolumesActionsTest-1738275594-project] 10.222.0.25 "GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd" status: 404 len: 111 microversion: 2.1 time: 0.071831 Jul 12 14:40:10.894664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 429/875] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:10 2022] GET /compute/v2.1/servers/ecd9a7d7-6b32-44ce-a357-2e6dfee707dd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:40:11.859126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-63703273-8084-42ec-816b-aacaf180e3ab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: .version_select at 0x7f01d31fac10>, body: {"keypair": {"name": "tempest-keypair-749149887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTylvZiFE7+/zx+6oSW8YxSj1pL8RvNlUxvMCmfTS6+F/0fo17TDW5Hr4TurBYE0lac/Q2NYL4yB0QFEzm3x6Pogar9sMC0emLrX4VQR1m7GBoKjwIOgy+jeRfkcHWyyQ=="}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:11.881962 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-63703273-8084-42ec-816b-aacaf180e3ab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:40:11.887556 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-63703273-8084-42ec-816b-aacaf180e3ab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for user 64206d561ee4456a8f8c670dfd2944a5 and project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'key_pairs'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:40:11.925968 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-63703273-8084-42ec-816b-aacaf180e3ab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.347706 Jul 12 14:40:11.930523 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 447/876] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:40:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:14.010785 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1395515345", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "648b017d-bc88-43ee-8595-cdd86bb231e6"}], "security_groups": [{"name": "tempest-securitygroup--343782111"}], "key_name": "tempest-keypair-749149887", "user_data": "}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:14.128485 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] validate_networks() for [('648b017d-bc88-43ee-8595-cdd86bb231e6', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:40:14.670958 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:40:14.671612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:40:14.672718 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:40:14.673145 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:40:14.673600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:40:14.686845 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.687675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.688923 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:14.689767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:14.717433 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:40:14.722006 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for user 64206d561ee4456a8f8c670dfd2944a5 and project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:40:14.734933 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:40:14.737466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:40:14.807827 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d5f0a839-7935-42f1-8f1e-3af6215e606b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.801319 Jul 12 14:40:14.808503 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 430/877] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:40:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:40:14.820042 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3cbf244e-c373-4c7c-96c2-f37f513bf854 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:14.820824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3cbf244e-c373-4c7c-96c2-f37f513bf854 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:14.958717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3cbf244e-c373-4c7c-96c2-f37f513bf854 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:14.968944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3cbf244e-c373-4c7c-96c2-f37f513bf854 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1237 microversion: 2.1 time: 0.152814 Jul 12 14:40:14.970285 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 448/878] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:14 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:15.997961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:15.998590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:16.023003 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.023480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.024259 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:16.024706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:16.138726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:16.147535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-957c1b6f-7625-4b01-aac6-0e9c54a119dc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1233 microversion: 2.1 time: 0.164586 Jul 12 14:40:16.149306 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 431/879] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:15 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1233 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:17.166249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:17.167568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:17.186057 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.186510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.187342 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:17.187825 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:17.268658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:17.278776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-27fde102-7efc-4d97-aacb-a622bddd5700 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1233 microversion: 2.1 time: 0.116716 Jul 12 14:40:17.279367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 449/880] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:17 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1233 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:18.296300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:18.296817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:18.303333 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.303782 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.304549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:18.304986 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:18.370065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:18.377600 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-95bbe2db-7ba8-4fa9-b3ac-dbf68aa3beda tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1289 microversion: 2.1 time: 0.085227 Jul 12 14:40:18.378185 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 432/881] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:18 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:19.396264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:19.398185 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:19.441622 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.442077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.442977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:19.443306 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:19.635362 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:19.643461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-500298b1-9808-4fea-a6a3-d342e6653aab tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.251885 Jul 12 14:40:19.644610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 450/882] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:19 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:20.174002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-db357502-3b1c-4a6d-b0aa-bf7817cbcb03 req-1018bf8a-60ef-41c9-b0ae-157dc0d9acc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883d95d2-8ecc-4d09-baa8-3f5d1949ddc4", "tag": "dfc911b7-45fc-41d3-975b-064cdd6310bc"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:20.201697 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-db357502-3b1c-4a6d-b0aa-bf7817cbcb03 req-1018bf8a-60ef-41c9-b0ae-157dc0d9acc8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.204489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-db357502-3b1c-4a6d-b0aa-bf7817cbcb03 req-1018bf8a-60ef-41c9-b0ae-157dc0d9acc8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.224164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-db357502-3b1c-4a6d-b0aa-bf7817cbcb03 req-1018bf8a-60ef-41c9-b0ae-157dc0d9acc8 service nova] Creating event network-changed:dfc911b7-45fc-41d3-975b-064cdd6310bc for instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 on hv-cinder-83699 Jul 12 14:40:20.230945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-db357502-3b1c-4a6d-b0aa-bf7817cbcb03 req-1018bf8a-60ef-41c9-b0ae-157dc0d9acc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060639 Jul 12 14:40:20.236217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 433/883] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:20.660588 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:20.661562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:20.668548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.668909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.669709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:20.670144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:20.831836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:20.843081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-61c5ee78-a18b-44e6-ac1d-a8bceeee91a6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.186527 Jul 12 14:40:20.843938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 451/884] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:20 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:21.456112 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-877742173", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1989063543", "security_groups": [{"name": "tempest-secgroup-smoke-943141086"}], "block_device_mapping_v2": [{"uuid": "2d741866-f6f3-4626-922c-b05429d8b82a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6738aee6-ace2-4e59-b649-77430daecb40"}]}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:21.603858 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] validate_networks() for [('6738aee6-ace2-4e59-b649-77430daecb40', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:40:21.865209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:21.866511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:21.875813 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.876256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:21.877290 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:21.877931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.063143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.089264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1270e0ae-ce77-4852-bf02-9dea0548f86e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.231860 Jul 12 14:40:22.091735 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 452/885] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:21 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:22.303932 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:40:22.304489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:40:22.305240 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:40:22.305805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:40:22.306326 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:40:22.322773 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.323354 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.324266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:22.327305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:22.369886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:40:22.378317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Getting quotas for user 42165c1e1b324fedbb926ac20f0f920a and project aac705367c454623a23f11bfa8d25756. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:40:22.458906 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:40:22.461903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d741866-f6f3-4626-922c-b05429d8b82a',volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:40:22.626209 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ab279a3b-c3f1-4ff2-bb12-59a5638c43f4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.174207 Jul 12 14:40:22.629009 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 434/886] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:40:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:40:22.639588 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4fccbdbd-f947-4b34-9f7f-790d7922ab1a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:22.640680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4fccbdbd-f947-4b34-9f7f-790d7922ab1a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:22.718391 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4fccbdbd-f947-4b34-9f7f-790d7922ab1a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:22.729090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4fccbdbd-f947-4b34-9f7f-790d7922ab1a tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1094 microversion: 2.1 time: 0.094140 Jul 12 14:40:22.730736 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 453/887] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:22 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:23.109154 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.110313 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.117817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.118337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.119981 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.121388 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.610821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.619681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c14f51e7-f372-41ca-a6f3-a19f884179c5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.515442 Jul 12 14:40:23.632734 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 435/888] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:23.748791 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:23.752611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:23.766490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.769125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.769972 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:23.771123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:23.844427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:23.855471 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-812535c4-f527-41f8-9303-150a1ce1e71f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1192 microversion: 2.1 time: 0.110246 Jul 12 14:40:23.857595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 454/889] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:23 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:24.651511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.653708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.671549 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.673706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.679198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.682129 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.877045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:24.878291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:24.899352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.900249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:24.901594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:24.902300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:25.030911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:25.040578 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cd5220d9-4a79-405e-909c-5eee532902c8 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1210 microversion: 2.1 time: 0.168425 Jul 12 14:40:25.042187 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 455/890] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:25.092398 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:25.105200 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-013b1a34-6a59-4dc2-883a-3b9542b927b3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.471591 Jul 12 14:40:25.107519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 436/891] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:24 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:26.058963 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:26.059596 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:26.068213 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.068992 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.070156 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.070833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.124450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:26.125722 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:26.134943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.139700 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.141114 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.141919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.359591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.363432 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:26.375453 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a6c3fa9c-ce3b-4d67-a869-052336aa7836 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.320148 Jul 12 14:40:26.376927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 456/892] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:26 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:26.382260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-ba5f2da8-457b-4fde-b202-dc6f9c0e1261 req-5aa88876-d46f-407c-bfd1-286c099ae2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0278e9ec-5114-4b6c-afcc-bf47a6518748", "tag": "be666cb1-e4b0-4c8c-8c56-836f6f632c20"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:26.393435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ba5f2da8-457b-4fde-b202-dc6f9c0e1261 req-5aa88876-d46f-407c-bfd1-286c099ae2ac service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.394201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ba5f2da8-457b-4fde-b202-dc6f9c0e1261 req-5aa88876-d46f-407c-bfd1-286c099ae2ac service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.430971 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-ba5f2da8-457b-4fde-b202-dc6f9c0e1261 req-5aa88876-d46f-407c-bfd1-286c099ae2ac service nova] Creating event network-changed:be666cb1-e4b0-4c8c-8c56-836f6f632c20 for instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 on hv-cinder-83699 Jul 12 14:40:26.453866 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-ba5f2da8-457b-4fde-b202-dc6f9c0e1261 req-5aa88876-d46f-407c-bfd1-286c099ae2ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075598 Jul 12 14:40:26.454797 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 457/893] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:26.460489 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-6cdd3a23-77d9-4d3a-96b5-1a6f2dca41d8 req-6e118fbb-d08b-475d-909c-aaf0d932cbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883d95d2-8ecc-4d09-baa8-3f5d1949ddc4", "name": "network-vif-plugged", "status": "completed", "tag": "dfc911b7-45fc-41d3-975b-064cdd6310bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:26.475499 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-6cdd3a23-77d9-4d3a-96b5-1a6f2dca41d8 req-6e118fbb-d08b-475d-909c-aaf0d932cbcb service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:26.475954 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-6cdd3a23-77d9-4d3a-96b5-1a6f2dca41d8 req-6e118fbb-d08b-475d-909c-aaf0d932cbcb service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:26.508958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-6cdd3a23-77d9-4d3a-96b5-1a6f2dca41d8 req-6e118fbb-d08b-475d-909c-aaf0d932cbcb service nova] Creating event network-vif-plugged:dfc911b7-45fc-41d3-975b-064cdd6310bc for instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 on hv-cinder-83699 Jul 12 14:40:26.514902 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-6cdd3a23-77d9-4d3a-96b5-1a6f2dca41d8 req-6e118fbb-d08b-475d-909c-aaf0d932cbcb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058795 Jul 12 14:40:26.523901 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 458/894] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:26.617484 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:26.626903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-3c43bfcb-5d6b-43b8-8e46-0bcbfa36aeb1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.506595 Jul 12 14:40:26.627483 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 437/895] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:26 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:40:27.397010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:27.398643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:27.406478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.409544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.410667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.411665 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.562269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.571655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bddcbbb7-4f65-4036-bfbd-b0c7fdd99c9c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.179287 Jul 12 14:40:27.580538 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 459/896] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:27 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:27.644132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:27.645647 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:27.653103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.653707 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.654736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:27.655297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:27.800098 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:27.809106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a68390f6-512e-4bfd-a81f-3d3dc4d2c8bf tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.169021 Jul 12 14:40:27.809728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 438/897] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:27 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:28.588075 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:28.589302 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:28.595981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.596433 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.597486 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.597926 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.741087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:28.749287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-43f86a7d-7b2c-46ba-8340-f4f333c482e7 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.164983 Jul 12 14:40:28.749899 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 460/898] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:28 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:28.826945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:28.828673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:28.836732 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.837188 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.838314 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:28.838931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:28.998947 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.009568 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bcca2461-c1ed-4d6f-a588-a1abecc68e1f tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.186293 Jul 12 14:40:29.010460 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 439/899] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:28 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:29.766989 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:29.767544 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:29.774753 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.775214 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.776035 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:29.776714 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:29.948317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:29.955745 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f24dfc9c-f1cb-4c7f-b41d-1328fa0bf24b tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.192901 Jul 12 14:40:29.956323 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 461/900] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:29 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:30.034731 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:30.036622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:30.044628 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.045079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.047499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.047499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.192856 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:30.201408 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-51e662df-7fdb-483b-a2b1-0de81dadc230 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.178527 Jul 12 14:40:30.210654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 440/901] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:30 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:30.973768 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:30.974518 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:30.982503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.982951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:30.983920 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:30.984351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.185133 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.203092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c2ce36f2-4384-4bbc-a1de-5ccc9dcfd87d tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.234132 Jul 12 14:40:31.215872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 462/902] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:30 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:31.230214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:31.231760 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:31.241762 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:31.242208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.243002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:31.244871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:31.507072 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:31.518374 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d1bd7861-3c6f-4adc-ba9b-b05c0af230bd tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1362 microversion: 2.1 time: 0.294489 Jul 12 14:40:31.519231 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 441/903] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:31 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:32.223442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.225247 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.236026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.237030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.238385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.239658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.445913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.454614 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9315763b-1f75-4d84-aef9-1039fac3ff28 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.236676 Jul 12 14:40:32.455490 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 463/904] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:32.536629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.537885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.540787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=4 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:32.541484 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=12 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:32.548342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.548943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.549920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.550546 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.697685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:32.705964 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-08654e4e-ee91-4b5d-85bf-aee2694ee4a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1549 microversion: 2.1 time: 0.173712 Jul 12 14:40:32.706610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 442/905] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:32.723219 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:32.723755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:32.729131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=8 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:32.731249 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.731739 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.732497 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:32.732937 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:32.823261 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-351bb74e-a7de-489c-9f27-ac247e317773 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103966 Jul 12 14:40:32.824121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 464/906] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:40:32 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:33.471886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:33.472559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:33.479611 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.480347 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.481443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.482058 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.708865 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:33.715920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=100 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:33.718327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-20920202-4f05-4388-b730-9d115a8944ed tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.250397 Jul 12 14:40:33.728519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 443/907] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:33 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:33.939444 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-bb305e47-9f79-4213-8119-e8d4080949b1 req-5acd5ee6-622a-4ae1-b56d-fe3b6362c0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883d95d2-8ecc-4d09-baa8-3f5d1949ddc4", "tag": "dfc911b7-45fc-41d3-975b-064cdd6310bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:33.949760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-bb305e47-9f79-4213-8119-e8d4080949b1 req-5acd5ee6-622a-4ae1-b56d-fe3b6362c0d8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:33.950581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-bb305e47-9f79-4213-8119-e8d4080949b1 req-5acd5ee6-622a-4ae1-b56d-fe3b6362c0d8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:33.966958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-bb305e47-9f79-4213-8119-e8d4080949b1 req-5acd5ee6-622a-4ae1-b56d-fe3b6362c0d8 service nova] Creating event network-changed:dfc911b7-45fc-41d3-975b-064cdd6310bc for instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 on hv-cinder-83699 Jul 12 14:40:33.973910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-bb305e47-9f79-4213-8119-e8d4080949b1 req-5acd5ee6-622a-4ae1-b56d-fe3b6362c0d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041993 Jul 12 14:40:33.977659 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 465/908] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:34.746121 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:34.747255 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:34.755124 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.756123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:34.757214 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:34.757894 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:35.017312 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:35.026975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f86ec844-344d-4a57-b2bd-b62442212558 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.294320 Jul 12 14:40:35.027563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 444/909] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:34 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:36.046816 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:36.047527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:36.063258 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.064522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.065652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:36.066262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:36.242591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:36.251070 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-efa96954-0b7e-4bce-84c8-1932c830490e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.208348 Jul 12 14:40:36.260566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 466/910] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:36 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:37.268149 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:37.268687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:37.276310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.276758 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.277566 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:37.278004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:37.408698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:37.416886 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d3efbe50-e8c6-49d9-9902-be490f9e5194 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.152766 Jul 12 14:40:37.417787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 445/911] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:37 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:38.433654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:38.434260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:38.440964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:38.441817 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:38.442608 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:38.443036 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:38.578268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:38.587519 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-617d87e4-af6c-4221-86fb-516f418a1d56 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.157782 Jul 12 14:40:38.588089 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 467/912] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:38 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:39.604777 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:39.605407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:39.611887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.612342 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:39.613103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:39.613578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:39.752755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:39.760302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9fae4615-3b0b-43e4-84c1-cbb5c40a4e35 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.159552 Jul 12 14:40:39.761530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 446/913] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:39 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:40.779175 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:40.779893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:40.787522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.788296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.789401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.789727 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-77b4ba43-4909-435a-8a40-0e939e047c4d req-7712e543-d8f2-4873-8a42-f24db1746be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0278e9ec-5114-4b6c-afcc-bf47a6518748", "name": "network-vif-plugged", "status": "completed", "tag": "be666cb1-e4b0-4c8c-8c56-836f6f632c20"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:40.790227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.799784 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-77b4ba43-4909-435a-8a40-0e939e047c4d req-7712e543-d8f2-4873-8a42-f24db1746be3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:40.800511 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-77b4ba43-4909-435a-8a40-0e939e047c4d req-7712e543-d8f2-4873-8a42-f24db1746be3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:40.813288 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-77b4ba43-4909-435a-8a40-0e939e047c4d req-7712e543-d8f2-4873-8a42-f24db1746be3 service nova] Creating event network-vif-plugged:be666cb1-e4b0-4c8c-8c56-836f6f632c20 for instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 on hv-cinder-83699 Jul 12 14:40:40.819474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-77b4ba43-4909-435a-8a40-0e939e047c4d req-7712e543-d8f2-4873-8a42-f24db1746be3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Jul 12 14:40:40.822011 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 447/914] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:40:40.938772 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:40.947391 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b51894ce-4ca4-4345-a72d-04c1603480e1 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.172544 Jul 12 14:40:40.948021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 468/915] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:40 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:41.965609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:41.966229 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:41.972568 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.973024 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:41.973846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:41.974287 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:42.178328 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:42.187775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f346dc6f-327b-4870-839a-46abdf64d9e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1265 microversion: 2.1 time: 0.226781 Jul 12 14:40:42.198337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 448/916] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:41 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:43.204563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:43.205183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:43.208277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:43.213566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:43.214021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.214789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:43.215227 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.354789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:43.362212 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d45bf858-ef3a-40bc-9e8f-b93d3710ed3c tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1452 microversion: 2.1 time: 0.161545 Jul 12 14:40:43.362774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 469/917] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:43 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:43.379033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:40:43.379655 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:40:43.386712 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:43.387164 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.387960 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:43.388397 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:43.523141 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:40:43.530761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-13b68c74-93eb-426e-a830-db9a21805c75 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1452 microversion: 2.1 time: 0.155550 Jul 12 14:40:43.531322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 449/918] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:40:43 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:40:45.665145 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-4c5a8e38-6828-44d6-a015-347b975c7e05 req-84f3402c-46fc-4ab6-bcd2-eacd12a6b4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0278e9ec-5114-4b6c-afcc-bf47a6518748", "tag": "be666cb1-e4b0-4c8c-8c56-836f6f632c20"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:40:45.675536 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4c5a8e38-6828-44d6-a015-347b975c7e05 req-84f3402c-46fc-4ab6-bcd2-eacd12a6b4dc service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:40:45.675913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4c5a8e38-6828-44d6-a015-347b975c7e05 req-84f3402c-46fc-4ab6-bcd2-eacd12a6b4dc service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:40:45.688289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-4c5a8e38-6828-44d6-a015-347b975c7e05 req-84f3402c-46fc-4ab6-bcd2-eacd12a6b4dc service nova] Creating event network-changed:be666cb1-e4b0-4c8c-8c56-836f6f632c20 for instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 on hv-cinder-83699 Jul 12 14:40:45.694026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-4c5a8e38-6828-44d6-a015-347b975c7e05 req-84f3402c-46fc-4ab6-bcd2-eacd12a6b4dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034047 Jul 12 14:40:45.694666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 470/919] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:04.595305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-06ef55c5-dcc3-45d0-915f-238dd6adfb05 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'create', calling method: .version_select at 0x7f01ce875790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-924437884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0fe1vtVqYTuPtFu27E1JfB9dCSEYnI7TvrtQ2nDpCWU1qRR9G8l7mmycChRMGIEdRPNxAOMfQAZzT+pDFLEv31L1x6plX/7BSleFqQEFNVmw04/+5lsXaUmNh6VA6DuA=="}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:04.600110 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:04.600864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=32 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:04.612866 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-06ef55c5-dcc3-45d0-915f-238dd6adfb05 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Getting quotas for project 51b448bb6d0542e9aeb90961739d9c06. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:04.616694 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-06ef55c5-dcc3-45d0-915f-238dd6adfb05 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Getting quotas for user 2a821209feb04c0a9f67aa6dfe7fb1e9 and project 51b448bb6d0542e9aeb90961739d9c06. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:04.638811 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-06ef55c5-dcc3-45d0-915f-238dd6adfb05 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047199 Jul 12 14:41:04.639314 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 450/920] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:41:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:41:04.684096 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:04.684841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=66 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:04.689524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1638323944", "imageRef": "5f72d4b0-f0ab-4945-a445-05c9d27a73e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-924437884", "networks": [{"uuid": "38b26bc7-5c15-49e2-bb10-db6e2ba5e161"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:04.741073 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] validate_networks() for [('38b26bc7-5c15-49e2-bb10-db6e2ba5e161', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:41:05.104747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:41:05.105177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:41:05.105693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:41:05.106101 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:41:05.106511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:41:05.116013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:05.116483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:05.117288 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:05.117755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:05.134668 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Getting quotas for project 51b448bb6d0542e9aeb90961739d9c06. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:41:05.138644 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Getting quotas for user 2a821209feb04c0a9f67aa6dfe7fb1e9 and project 51b448bb6d0542e9aeb90961739d9c06. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:41:05.149321 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:41:05.151597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5f72d4b0-f0ab-4945-a445-05c9d27a73e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:41:05.196887 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-aea63768-f3c2-470e-8394-2c6331b3b357 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514335 Jul 12 14:41:05.197563 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 471/921] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:41:05.207883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-de498305-4d36-4e0e-abe9-4deb59a31f13 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:05.208501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-de498305-4d36-4e0e-abe9-4deb59a31f13 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:05.263688 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-de498305-4d36-4e0e-abe9-4deb59a31f13 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:05.271071 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-de498305-4d36-4e0e-abe9-4deb59a31f13 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1258 microversion: 2.1 time: 0.067552 Jul 12 14:41:05.271637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 451/922] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:05 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:06.288081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:06.288696 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:06.296182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:06.296633 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:06.297441 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:06.297880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:06.362661 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:06.370798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-341a281f-7e75-42b6-8a1f-afa51f75805a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1318 microversion: 2.1 time: 0.086731 Jul 12 14:41:06.371810 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 472/923] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:06 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:07.389070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:07.390517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:07.398524 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:07.399230 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:07.400219 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:07.400814 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:07.570770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:07.578365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-21291d59-e74e-44eb-9d7a-ee007574c963 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.193602 Jul 12 14:41:07.578934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 452/924] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:07 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:08.595603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:08.596222 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:08.603541 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:08.603999 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:08.604771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:08.605208 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:08.744318 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:08.751780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fbab889e-6d34-44f1-ac76-5857b8b586bf tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.160112 Jul 12 14:41:08.752341 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 473/925] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:08 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:09.770179 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:09.771046 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:09.779247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:09.779787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:09.780633 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:09.781346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:10.062438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:10.070090 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-ffba14a4-d9e7-4054-8fe0-e7588d2e476d tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.304833 Jul 12 14:41:10.070653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 453/926] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:09 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:10.474849 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:10.475427 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:10.482006 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:10.482457 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:10.483221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:10.483658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:10.507143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6fa9c88d-ca74-4a3d-ba0d-605cded85f47 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/ips" status: 200 len: 146 microversion: 2.1 time: 0.036752 Jul 12 14:41:10.507699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 474/927] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:41:10 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:11.087755 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:11.088445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:11.094981 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:11.095442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:11.096190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:11.096622 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:11.239271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:11.246945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-96241d3a-59f0-40c3-a67f-9474c700a1c8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.163271 Jul 12 14:41:11.247508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 454/928] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:11 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:12.263534 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:12.264177 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:12.270789 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:12.271481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:12.272268 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:12.272709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:12.416626 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:12.424731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ed56c4f4-524c-45b1-b6ae-6d9c51d9de69 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.165555 Jul 12 14:41:12.425308 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 475/929] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:12 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:13.445190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:13.445948 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:13.453351 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:13.453919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:13.454745 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:13.455247 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:13.588147 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:13.595557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c39ff592-25e9-42b6-9d88-77aa59223d49 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.156209 Jul 12 14:41:13.596123 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 455/930] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:13 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:14.613553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:14.614155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:14.620671 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:14.621121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:14.621926 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:14.622363 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:14.766640 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:14.775046 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ffd43230-daee-4314-a557-57ab5663cc16 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.165554 Jul 12 14:41:14.775622 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 476/931] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:14 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:15.083585 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8400374-6b08-47ca-b0e6-69e78d32e190"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:15.084706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:15.091375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.091823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.092589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.093028 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.267849 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:15.791892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:15.792513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:15.794397 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:15.795137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:15.802970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.803413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.804204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:15.804634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:15.946661 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:15.954155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fca44855-b948-4de5-a1b2-b1d6b0e38058 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.166168 Jul 12 14:41:15.954709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 477/932] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:15 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:16.892875 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-59f09542-6d0b-4a87-92fa-cd0dea3b71b2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.813055 Jul 12 14:41:16.893521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 456/933] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:41:15 2022] POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments => generated 194 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:16.970804 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:16.971421 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:16.978123 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.978577 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:16.979354 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:16.979774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:17.119809 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:17.127918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fe5e737f-7482-4501-84ff-500e92ad0d2b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.160888 Jul 12 14:41:17.128932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 478/934] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:16 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:17.376370 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-a9a47396-fb18-4271-8424-b549ae1c252b req-68dd80f1-a07f-4f5f-9dfa-07d5b89fc34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:17.390770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a9a47396-fb18-4271-8424-b549ae1c252b req-68dd80f1-a07f-4f5f-9dfa-07d5b89fc34d service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:17.391538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a9a47396-fb18-4271-8424-b549ae1c252b req-68dd80f1-a07f-4f5f-9dfa-07d5b89fc34d service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:17.404224 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-a9a47396-fb18-4271-8424-b549ae1c252b req-68dd80f1-a07f-4f5f-9dfa-07d5b89fc34d service nova] Creating event network-changed:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:41:17.409308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-a9a47396-fb18-4271-8424-b549ae1c252b req-68dd80f1-a07f-4f5f-9dfa-07d5b89fc34d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043520 Jul 12 14:41:17.410340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 457/935] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:18.145754 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:18.146374 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:18.152824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.153277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.154077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:18.154516 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:18.282929 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:18.290848 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5a1e0909-6074-44ac-8e39-22abcaabe76a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.149530 Jul 12 14:41:18.291413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 479/936] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:18 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:19.308670 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:19.309349 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:19.315867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.316902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.317708 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:19.318150 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:19.444705 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:19.452190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9d812d83-805c-43fa-bac8-c8d21e5b0493 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.148361 Jul 12 14:41:19.452750 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 458/937] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:19 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:20.469224 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:20.469878 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:20.476867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.477310 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.478095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:20.478525 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:20.609908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:20.617801 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-15bf5b8f-2344-4dae-b16f-cb334374e40c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.152447 Jul 12 14:41:20.618356 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 480/938] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:20 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:21.634657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:21.635210 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:21.641748 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.642198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.642961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:21.643396 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:21.773420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:21.780816 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-769fe4b8-675a-4854-af7c-42a7e92dafcd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.150149 Jul 12 14:41:21.781383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 459/939] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:21 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:22.798036 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:22.798649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:22.805748 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.806208 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:22.806965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:22.807402 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:22.936945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:22.944769 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3327a563-3418-4f3f-87f2-858ae7cefb83 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.150675 Jul 12 14:41:22.945553 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 481/940] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:22 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:23.009829 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-e8ad8454-787c-4143-b4bf-66caf6b85d2a req-66727fea-ad0f-49d1-95f5-71392f3636d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "name": "network-vif-plugged", "status": "completed", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:23.018471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-e8ad8454-787c-4143-b4bf-66caf6b85d2a req-66727fea-ad0f-49d1-95f5-71392f3636d9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.019547 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-e8ad8454-787c-4143-b4bf-66caf6b85d2a req-66727fea-ad0f-49d1-95f5-71392f3636d9 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.031374 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-e8ad8454-787c-4143-b4bf-66caf6b85d2a req-66727fea-ad0f-49d1-95f5-71392f3636d9 service nova] Creating event network-vif-plugged:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:41:23.036852 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-e8ad8454-787c-4143-b4bf-66caf6b85d2a req-66727fea-ad0f-49d1-95f5-71392f3636d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031319 Jul 12 14:41:23.037608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 460/941] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:23.963171 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:23.963781 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:23.970392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.970839 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:23.971597 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:23.972026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.101016 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:24.108567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9a215ee0-3c57-49f4-bd59-a7fbfd67e7b0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1358 microversion: 2.1 time: 0.149298 Jul 12 14:41:24.109129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 482/942] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:23 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:24.378902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f79223ad-7b99-4f55-abb5-88d69a0baee5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:24.385098 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f79223ad-7b99-4f55-abb5-88d69a0baee5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.385640 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f79223ad-7b99-4f55-abb5-88d69a0baee5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.445457 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f79223ad-7b99-4f55-abb5-88d69a0baee5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Going to try to stop instance {{(pid=124549) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 14:41:24.486517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f79223ad-7b99-4f55-abb5-88d69a0baee5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action" status: 202 len: 0 microversion: 2.1 time: 0.112678 Jul 12 14:41:24.487059 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 461/943] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:41:24 2022] POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:41:24.496930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:24.497570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:24.505155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.505873 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.506646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:24.507934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:24.635160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:24.643812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-97d877e9-70c5-4de1-a6b6-579f8e63b12b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.152080 Jul 12 14:41:24.644888 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 483/944] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:24 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:25.126431 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.127186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:25.133853 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.134297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.135057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.135487 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.263882 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.271864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f9364b10-83e7-4fbb-a1d2-e0bb216e3c5e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1547 microversion: 2.1 time: 0.149767 Jul 12 14:41:25.272420 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 462/945] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:25.288666 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.289278 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:25.295740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.296287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.303115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.303115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.423254 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.430818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d1471341-cdc1-435f-ace1-fd14e22e2d4a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1547 microversion: 2.1 time: 0.146845 Jul 12 14:41:25.431381 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 484/946] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:25.446601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.450045 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.450808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Searching by: {'deleted': False, 'project_id': '51b448bb6d0542e9aeb90961739d9c06'} {{(pid=124549) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 14:41:25.458438 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.458868 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.459679 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.460108 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.549935 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.multi_cell_list [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124549) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 14:41:25.641558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-841272bc-e0e1-46f1-938a-c0f3c169b17c tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198674 Jul 12 14:41:25.642132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 463/947] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:25.652287 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.652904 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:25.660670 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.661113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:25.661238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.661848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:25.661959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.662319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.668077 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.668458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.669215 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:25.669678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:25.793131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.798952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:25.801243 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-24dbf4b7-007d-4025-a1e7-e3ebe8305e93 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1547 microversion: 2.1 time: 0.152681 Jul 12 14:41:25.801848 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 485/948] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:25.806919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c302d9c7-e22e-43e5-a800-d8548a65af98 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.150104 Jul 12 14:41:25.807472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 464/949] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:25 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:26.824102 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:26.824766 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:26.831858 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.832313 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.833077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:26.833557 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:26.959178 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:26.967176 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0aa4a168-9693-4c58-a0f7-50058549ed59 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.147164 Jul 12 14:41:26.967740 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 486/950] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:26 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:27.306397 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2a8753e-1379-4271-856b-abfb94560609"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:27.307513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:27.313999 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.314445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.315459 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.316383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.563992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:27.574026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-200cb1e1-8f03-4cdc-86e2-bea1f1533678 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271456 Jul 12 14:41:27.574675 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 465/951] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:41:27 2022] POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:41:27.984050 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:27.985401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:27.991915 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.992359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:27.993155 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:27.993607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:28.138990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:28.147447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b6bf27e3-6ccf-4350-aa59-b471e4a22f49 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.167485 Jul 12 14:41:28.148010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 487/952] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:27 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:29.166506 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:29.167198 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:29.173589 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:29.174036 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:29.174788 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:29.175715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:29.305996 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:29.313984 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d76a910b-70b2-4e39-8e53-e434e269e869 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.152964 Jul 12 14:41:29.314557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 466/953] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:29 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:30.331699 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:30.332311 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:30.339009 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.339456 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:30.340216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:30.340651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:30.504687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=100 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:30.614028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:30.621876 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9650a2a6-5093-4193-b8be-7c1f4aac2df0 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.294043 Jul 12 14:41:30.622435 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 488/954] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:30 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:31.638832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:31.639448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:31.646199 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:31.646642 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:31.647404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:31.647837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:31.775909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:31.783818 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c0b096fa-152b-488a-83d0-57272db15a2b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.149012 Jul 12 14:41:31.784871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 467/955] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:31 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:32.801296 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:32.802052 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:32.808706 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.809185 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.810026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:32.810463 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:32.942030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:32.949890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-b05d7678-9a44-4748-9f72-86e3e911da97 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.152498 Jul 12 14:41:32.950454 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 489/956] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:32 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:33.966604 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:33.967210 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:33.974138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.974581 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:33.975331 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:33.975763 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:34.102754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:34.110656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d37fdc03-10e3-4629-9cf4-5b8153a608a7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.147845 Jul 12 14:41:34.111220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 468/957] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:33 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:35.103709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:35.104324 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:35.106694 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:35.111824 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.112270 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.113606 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.114039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.127607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:35.128866 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:35.131371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:35.136943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.137407 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.138172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:35.138601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:35.242221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:35.250167 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-81ce9749-395d-4630-9de7-996c940979b8 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1593 microversion: 2.1 time: 0.150279 Jul 12 14:41:35.250721 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 490/958] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:35 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:35.275225 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:35.283272 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e6e21758-7bc6-4c6b-940f-0672f29912c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.159608 Jul 12 14:41:35.283919 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 469/959] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:35 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:36.300631 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:36.301409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:36.307892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.308332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.309088 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:36.309551 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:36.529610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:36.538934 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-df3e0a89-a5e9-4696-806e-9c5fc743a90b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.242767 Jul 12 14:41:36.539727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 491/960] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:36 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:36.998478 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-aac0f740-6acb-4cba-b11d-289c56ca251c req-e4485b25-cd9a-45da-8632-42bad1fe6c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:37.004560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:37.010821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-aac0f740-6acb-4cba-b11d-289c56ca251c req-e4485b25-cd9a-45da-8632-42bad1fe6c17 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.012103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-aac0f740-6acb-4cba-b11d-289c56ca251c req-e4485b25-cd9a-45da-8632-42bad1fe6c17 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:37.026035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-aac0f740-6acb-4cba-b11d-289c56ca251c req-e4485b25-cd9a-45da-8632-42bad1fe6c17 service nova] Creating event network-changed:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:41:37.033169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-aac0f740-6acb-4cba-b11d-289c56ca251c req-e4485b25-cd9a-45da-8632-42bad1fe6c17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038450 Jul 12 14:41:37.035023 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 470/961] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:37.556634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:37.558017 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:37.566274 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.566925 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:37.567782 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:37.568508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.047738 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:38.064076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0e0a6ad1-e6ef-4683-9c7c-1c5c0acc38c8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.510833 Jul 12 14:41:38.066826 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 492/962] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:37 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:38.090500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1154248452"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:38.091117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:38.097417 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.097893 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.098753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.099275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.237184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.network.security_group_api [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Adding security group ccf52f21-aa97-4c6f-8c61-0f21b02b6b74 to port e85e127d-8daa-4def-ba93-910bf3970543 Jul 12 14:41:38.585605 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5a158b39-76fa-45ee-aecb-62af3ac743cd tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action" status: 202 len: 0 microversion: 2.1 time: 0.500294 Jul 12 14:41:38.589078 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 471/963] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:41:38 2022] POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 14:41:38.596607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:38.600335 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:38.608116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-943ea57d-272d-4456-a400-4d639e6097f0 req-4f09b507-ba24-4cba-9e3b-dd5fa9afe045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:38.610836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.611291 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.612072 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.615775 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.625880 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-943ea57d-272d-4456-a400-4d639e6097f0 req-4f09b507-ba24-4cba-9e3b-dd5fa9afe045 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:38.626556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-943ea57d-272d-4456-a400-4d639e6097f0 req-4f09b507-ba24-4cba-9e3b-dd5fa9afe045 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:38.641005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-943ea57d-272d-4456-a400-4d639e6097f0 req-4f09b507-ba24-4cba-9e3b-dd5fa9afe045 service nova] Creating event network-changed:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:41:38.650971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-943ea57d-272d-4456-a400-4d639e6097f0 req-4f09b507-ba24-4cba-9e3b-dd5fa9afe045 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046352 Jul 12 14:41:38.651990 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 472/964] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:41:38.876305 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:38.889725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-56c80034-094c-4128-9f97-f36910316820 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1758 microversion: 2.1 time: 0.298914 Jul 12 14:41:38.895492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 493/965] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:38 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1758 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:39.084659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:39.085486 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:39.092319 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.093510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.094364 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:39.094867 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:39.238338 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:39.246609 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8f2d1ad7-2be7-497f-a553-34af963a4d9a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1723 microversion: 2.1 time: 0.166368 Jul 12 14:41:39.247610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 473/966] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:39 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:40.266221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:40.267210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:40.273724 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.274170 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.275275 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.275711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.408774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:40.417510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0a485095-c902-4304-a2ff-2b9db4b7698e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1700 microversion: 2.1 time: 0.157285 Jul 12 14:41:40.418077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 494/967] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:40 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:40.433945 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-31bd0bbe-44cb-42c0-898d-3943cd91f264 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:41:40.441365 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-31bd0bbe-44cb-42c0-898d-3943cd91f264 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.441827 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-31bd0bbe-44cb-42c0-898d-3943cd91f264 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.463335 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-31bd0bbe-44cb-42c0-898d-3943cd91f264 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Going to try to start instance {{(pid=124549) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 14:41:40.503499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-31bd0bbe-44cb-42c0-898d-3943cd91f264 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action" status: 202 len: 0 microversion: 2.1 time: 0.073135 Jul 12 14:41:40.504186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 474/968] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:41:40 2022] POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:41:40.512209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:40.512818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:40.520044 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.520529 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.521320 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:40.521793 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:40.655722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:40.663862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d6dfa6f5-4753-4cdf-a55b-b105daef6adb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1709 microversion: 2.1 time: 0.155352 Jul 12 14:41:40.664370 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 495/969] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:40 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:41:41.682540 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:41.683155 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:41.689386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.690095 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.690897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:41.691321 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:41.820340 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:41.828805 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-289b8814-a9d1-412d-a85b-d3f2888c7704 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1709 microversion: 2.1 time: 0.151183 Jul 12 14:41:41.829417 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 475/970] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:41 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:41:42.846709 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:41:42.847406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:41:42.853945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.854401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.855179 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:41:42.855615 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:41:42.991152 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:41:42.999131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-faaef6d1-2eac-401d-b542-3a995474f5c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1713 microversion: 2.1 time: 0.156407 Jul 12 14:41:42.999695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 496/971] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:41:42 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:01.445916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:01.446861 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:01.449447 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=13 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:01.450091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:01.456109 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.456560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.457367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.457792 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.530035 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-cd717f6f-27ee-44e2-a2ba-f1e9d5b7d1d2 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action" status: 202 len: 0 microversion: 2.1 time: 0.087744 Jul 12 14:42:01.530691 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 476/972] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:01 2022] POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:01.539337 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:01.539959 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:01.542367 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=13 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:01.543041 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=50 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:01.549344 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.549972 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.550734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:01.551281 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:01.790464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:01.798466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-65e349ee-f605-4f12-bc06-a80a1212cda5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1750 microversion: 2.1 time: 0.263048 Jul 12 14:42:01.799045 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 497/973] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:01 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:02.817596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:02.818308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:02.824771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.825221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.826008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:02.826442 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:02.973172 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:02.981294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c4aa8425-1749-4058-a7ad-f6042bcb2a23 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.168898 Jul 12 14:42:02.981887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 477/974] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:02 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:03.998950 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:03.999580 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:04.006616 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:04.007063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:04.007816 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:04.008246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:04.150610 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:04.158513 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-dafcb97d-059c-4369-ad39-9e5c3da0e83b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.163375 Jul 12 14:42:04.159062 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 498/975] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:03 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:05.176190 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:05.176826 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:05.183468 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.183907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:05.184662 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:05.185091 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:05.329649 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:05.337740 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5c1f894a-99e0-4aa6-9648-1bc6bf6a3383 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.166150 Jul 12 14:42:05.338310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 478/976] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:05 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:06.355232 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:06.355843 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:06.362997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:06.363449 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.364210 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:06.364646 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:06.505669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:06.513578 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-495711ba-99f7-48bb-ac02-6344ccbdf01f tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.162257 Jul 12 14:42:06.514139 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 499/977] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:06 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:07.530567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:07.531187 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:07.538220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.538668 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.539428 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:07.539864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:07.678026 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:07.685909 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1769efd4-f016-4209-a3f6-95d47410d549 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.159196 Jul 12 14:42:07.686474 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 479/978] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:07 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:08.703512 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:08.704125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:08.711269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.711722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.712491 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:08.712931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:08.851137 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:08.859157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c2bb152f-37fa-4897-acbb-5c252c6cd667 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.159535 Jul 12 14:42:08.859698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 500/979] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:08 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:09.876463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:09.877119 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:09.884220 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.884669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:09.885458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:09.885896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:10.027872 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:10.036324 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5e7b4927-1672-4985-8f87-447b4852ad35 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.163871 Jul 12 14:42:10.036974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 480/980] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:09 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:11.053506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:11.054115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:11.060495 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:11.060941 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:11.061725 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:11.062166 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:11.206005 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:11.213895 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2b9c25db-f9d7-42d9-830f-5d2dc320792a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.164281 Jul 12 14:42:11.214445 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 501/981] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:11 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:12.230912 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:12.231528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:12.238787 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.239245 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:12.240008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:12.240443 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:12.381512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:12.389437 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-c5e2f2e2-3fd3-4b03-a447-6a714f403928 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1755 microversion: 2.1 time: 0.162468 Jul 12 14:42:12.390000 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 481/982] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:12 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:13.406946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:13.407611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:13.414945 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:13.415393 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:13.416164 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:13.416601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:13.561317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:13.570141 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-1a957ee9-d68e-4d17-9db0-0e54e2678313 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1758 microversion: 2.1 time: 0.167106 Jul 12 14:42:13.570712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 502/983] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:13 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:21.246508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:21.247115 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:21.253770 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.254224 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.254994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:21.255432 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:21.333076 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lazy-loading 'services' on Instance uuid 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:42:21.403161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a52a0cfc-5a54-4b9b-8649-d2c0ebfcb6c2 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments/e8400374-6b08-47ca-b0e6-69e78d32e190" status: 202 len: 0 microversion: 2.1 time: 0.160442 Jul 12 14:42:21.403741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 482/984] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:42:21 2022] DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments/e8400374-6b08-47ca-b0e6-69e78d32e190 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:22.517722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-49a7428c-2799-4b3f-b24c-c82d8a4dbc43 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:22.524622 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-49a7428c-2799-4b3f-b24c-c82d8a4dbc43 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.525068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-49a7428c-2799-4b3f-b24c-c82d8a4dbc43 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.587090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-49a7428c-2799-4b3f-b24c-c82d8a4dbc43 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Going to try to stop instance {{(pid=124550) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 14:42:22.631392 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-49a7428c-2799-4b3f-b24c-c82d8a4dbc43 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action" status: 202 len: 0 microversion: 2.1 time: 0.117372 Jul 12 14:42:22.631890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 503/985] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:22 2022] POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:22.641082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:22.641821 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:22.648566 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.649014 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.650070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.650507 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.867839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:22.875591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-30005894-270a-488a-89e8-17cefb393c94 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.239281 Jul 12 14:42:22.876176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 483/986] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:22 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:22.911744 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:22.912401 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:22.914525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-69c9c6e6-ec31-4214-914e-51541a0d2656 req-5ceb4e2c-5291-45ad-903e-8c3df5ee19c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0278e9ec-5114-4b6c-afcc-bf47a6518748", "tag": "be666cb1-e4b0-4c8c-8c56-836f6f632c20"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:22.919184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.919882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.920829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.921260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.923106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-69c9c6e6-ec31-4214-914e-51541a0d2656 req-5ceb4e2c-5291-45ad-903e-8c3df5ee19c8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:22.923556 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-69c9c6e6-ec31-4214-914e-51541a0d2656 req-5ceb4e2c-5291-45ad-903e-8c3df5ee19c8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:22.936076 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-69c9c6e6-ec31-4214-914e-51541a0d2656 req-5ceb4e2c-5291-45ad-903e-8c3df5ee19c8 service nova] Creating event network-changed:be666cb1-e4b0-4c8c-8c56-836f6f632c20 for instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 on hv-cinder-83699 Jul 12 14:42:22.941656 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-69c9c6e6-ec31-4214-914e-51541a0d2656 req-5ceb4e2c-5291-45ad-903e-8c3df5ee19c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030898 Jul 12 14:42:22.942248 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 484/987] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:22.948084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:42:23.029039 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e032d755-4142-498a-bb14-31fbd9649fe4 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 204 len: 0 microversion: 2.1 time: 0.121189 Jul 12 14:42:23.032730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 504/988] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:42:22 2022] DELETE /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:42:23.039194 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:23.039903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:23.046233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.046686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.047461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.047897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.182019 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:23.190113 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1c8e190e-4453-4621-b632-1044c9139d33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1576 microversion: 2.1 time: 0.154510 Jul 12 14:42:23.190938 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 485/989] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:23 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:23.893299 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:23.895014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:23.901180 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.901698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:23.902466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:23.902905 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:24.032613 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.040162 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-63d5801e-814e-41d8-94de-c12159b50db9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.151499 Jul 12 14:42:24.040880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 505/990] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:23 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:24.207928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:24.208454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:24.215027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:24.215483 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:24.216251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:24.216692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:24.348105 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:24.355841 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-937f6805-8a95-4ce7-8f54-97bfba9d4d71 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1576 microversion: 2.1 time: 0.151919 Jul 12 14:42:24.356410 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 486/991] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:24 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:25.057669 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:25.058434 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:25.066352 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.066939 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.068019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.068564 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.205909 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.213450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2c7b3422-22f8-4264-a0d1-bf3ae7fa0bef tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.159681 Jul 12 14:42:25.214014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 506/992] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:25 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:25.330920 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-a23c970b-8e5d-4f2e-b02e-64bdd8327eb9 req-9bfd0d00-2646-4777-afde-f2cba168459c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0278e9ec-5114-4b6c-afcc-bf47a6518748", "name": "network-vif-deleted", "tag": "be666cb1-e4b0-4c8c-8c56-836f6f632c20"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:25.339376 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a23c970b-8e5d-4f2e-b02e-64bdd8327eb9 req-9bfd0d00-2646-4777-afde-f2cba168459c service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.339820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a23c970b-8e5d-4f2e-b02e-64bdd8327eb9 req-9bfd0d00-2646-4777-afde-f2cba168459c service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.350896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-a23c970b-8e5d-4f2e-b02e-64bdd8327eb9 req-9bfd0d00-2646-4777-afde-f2cba168459c service nova] Creating event network-vif-deleted:be666cb1-e4b0-4c8c-8c56-836f6f632c20 for instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 on hv-cinder-83699 Jul 12 14:42:25.355488 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-a23c970b-8e5d-4f2e-b02e-64bdd8327eb9 req-9bfd0d00-2646-4777-afde-f2cba168459c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028287 Jul 12 14:42:25.356073 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 487/993] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:25.372183 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:25.372804 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:25.379727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.380184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.380957 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:25.381415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:25.445076 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:25.452539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fd2ace85-f630-4aa0-bc3e-abf67c5d5d81 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 200 len: 1225 microversion: 2.1 time: 0.084204 Jul 12 14:42:25.453097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 507/994] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:25 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:26.232630 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:26.233553 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:26.240678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.241132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.241931 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.242370 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.379895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:26.387607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-beb11e45-e63f-42bf-88fd-9d673fc2d403 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.160790 Jul 12 14:42:26.388169 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 488/995] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:26 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:26.469294 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:26.469911 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 0278e9ec-5114-4b6c-afcc-bf47a6518748] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:26.476969 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.477451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.478216 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:26.478652 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:26.492313 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] HTTP exception thrown: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Request method failure captured: Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 HTTP/1.1 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYZ0cS-Kp42Co_vYPLUf7knWNAYoqaZ4cY2PF5dAW9XCYRTpAGds_KtJwfrXARDxaV-yDRYlGmiSjfEDREqz2Rf6_IEYXbRUzoaqrentRu_68WNmkkTFpYpyTmBnCEoWgE5aCKH36VWxRx3rFq0fgAHa_nIF9tMaUzvVcjKBAyPt8jc Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:42:26.493951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aac705367c454623a23f11bfa8d25756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aac705367c454623a23f11bfa8d25756", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 42165c1e1b324fedbb926ac20f0f920a Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. Jul 12 14:42:26.495686 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '0278e9ec-5114-4b6c-afcc-bf47a6518748'} Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:26.496595 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. Jul 12 14:42:26.498231 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:26.499687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Returning 404 to user: Instance 0278e9ec-5114-4b6c-afcc-bf47a6518748 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:26.499687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-16999e5b-2fda-4e4e-88f2-4a7f74cb98e0 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748" status: 404 len: 111 microversion: 2.1 time: 0.029933 Jul 12 14:42:26.499687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 508/996] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:26 2022] GET /compute/v2.1/servers/0278e9ec-5114-4b6c-afcc-bf47a6518748 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:42:27.404676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:27.405314 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:27.412416 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.412871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.413674 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:27.414112 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:27.678513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:27.686252 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-790cf742-c31f-47db-8c10-3db837d004a3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.285426 Jul 12 14:42:27.686817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 489/997] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:27 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:28.703607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:28.704223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:28.711369 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.711821 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:28.712578 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:28.713034 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:28.849158 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:28.857857 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-4d5556e7-e862-4174-8154-7ecf2c1607ce tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.158142 Jul 12 14:42:28.858542 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 509/998] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:28 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:29.795284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:29.795952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:29.796913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-2acbf320-613d-42aa-81a3-69640cce4c7f req-a1a33c03-d54b-4904-86f9-21ee16337dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79871b04-6603-485a-82e7-bbcd6dbf65dd", "tag": "234c364b-ee17-4a48-a122-11e6ffb25c40"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:29.802964 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.803425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.804204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.804832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.806394 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2acbf320-613d-42aa-81a3-69640cce4c7f req-a1a33c03-d54b-4904-86f9-21ee16337dd3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.806896 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-2acbf320-613d-42aa-81a3-69640cce4c7f req-a1a33c03-d54b-4904-86f9-21ee16337dd3 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.818481 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-2acbf320-613d-42aa-81a3-69640cce4c7f req-a1a33c03-d54b-4904-86f9-21ee16337dd3 service nova] Creating event network-changed:234c364b-ee17-4a48-a122-11e6ffb25c40 for instance 79871b04-6603-485a-82e7-bbcd6dbf65dd on hv-cinder-83699 Jul 12 14:42:29.823660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-2acbf320-613d-42aa-81a3-69640cce4c7f req-a1a33c03-d54b-4904-86f9-21ee16337dd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030532 Jul 12 14:42:29.824675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 510/999] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:29.832276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:42:29.875757 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:29.876800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:29.879974 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:29.884704 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.885361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.886315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.886912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.930610 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8aee47c5-f541-4239-bc31-82a43236e22f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 204 len: 0 microversion: 2.1 time: 0.139045 Jul 12 14:42:29.931339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 490/1000] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:42:29 2022] DELETE /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:42:29.940659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:29.941376 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:29.950652 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.951378 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.952338 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:29.952930 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:29.993770 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:42:29.993946 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 (ip 10.222.0.25) !!! Jul 12 14:42:30.044439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.053267 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c10f05a1-1599-4822-87dc-fd27f88f3925 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.181821 Jul 12 14:42:30.054209 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 511/1001] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:29 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:30.101679 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:30.109415 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-76ab6989-83b9-446c-ae8b-3ab5daed7584 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1577 microversion: 2.1 time: 0.173967 Jul 12 14:42:30.109987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 491/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:29 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:31.071368 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:31.071982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:31.078478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.078928 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.080406 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.080874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.085576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:31.130517 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:31.131165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:31.138017 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.138466 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.139234 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:31.139665 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:31.213874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.221390 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ff75ec7b-0850-4c29-8b42-ab66f60ac3c3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.153993 Jul 12 14:42:31.221956 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 512/1003] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:31 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:31.303956 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:31.311784 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fbe6c15e-63de-48ad-ae22-4d7862aacf33 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1577 microversion: 2.1 time: 0.185726 Jul 12 14:42:31.312346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 492/1004] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:31 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:32.239233 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:32.239856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:32.242201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.247405 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.247897 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.248756 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.249199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.329664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:32.330327 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:32.332736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.338761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.339216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.339997 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.340427 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.415130 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42165c1e1b324fedbb926ac20f0f920a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac705367c454623a23f11bfa8d25756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.424751 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7b6452e3-4a0a-4111-a94e-948d84ae87d6 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 200 len: 1392 microversion: 2.1 time: 0.098969 Jul 12 14:42:32.425379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 493/1005] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:32 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 1392 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:32.431106 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-64f8440b-47d4-4935-8b06-d5557bc04e09 req-80201f6a-0236-4e93-b309-9baf6b23292c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79871b04-6603-485a-82e7-bbcd6dbf65dd", "name": "network-vif-deleted", "tag": "234c364b-ee17-4a48-a122-11e6ffb25c40"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:32.440728 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-64f8440b-47d4-4935-8b06-d5557bc04e09 req-80201f6a-0236-4e93-b309-9baf6b23292c service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:32.441166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-64f8440b-47d4-4935-8b06-d5557bc04e09 req-80201f6a-0236-4e93-b309-9baf6b23292c service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:32.452982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-64f8440b-47d4-4935-8b06-d5557bc04e09 req-80201f6a-0236-4e93-b309-9baf6b23292c service nova] Creating event network-vif-deleted:234c364b-ee17-4a48-a122-11e6ffb25c40 for instance 79871b04-6603-485a-82e7-bbcd6dbf65dd on hv-cinder-83699 Jul 12 14:42:32.458079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-64f8440b-47d4-4935-8b06-d5557bc04e09 req-80201f6a-0236-4e93-b309-9baf6b23292c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031486 Jul 12 14:42:32.458687 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 494/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:32.489601 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:32.496982 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fa741605-7e83-4e2f-91b8-62548ba1cef3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1677 microversion: 2.1 time: 0.262188 Jul 12 14:42:32.497576 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 513/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:32 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:33.443614 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.444338 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 79871b04-6603-485a-82e7-bbcd6dbf65dd] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.450518 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.450959 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.451710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.452140 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.465613 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] HTTP exception thrown: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Request method failure captured: Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd HTTP/1.1 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZ0cS-Kp42Co_vYPLUf7knWNAYoqaZ4cY2PF5dAW9XCYRTpAGds_KtJwfrXARDxaV-yDRYlGmiSjfEDREqz2Rf6_IEYXbRUzoaqrentRu_68WNmkkTFpYpyTmBnCEoWgE5aCKH36VWxRx3rFq0fgAHa_nIF9tMaUzvVcjKBAyPt8jc Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:42:33.467186 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aac705367c454623a23f11bfa8d25756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aac705367c454623a23f11bfa8d25756", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 42165c1e1b324fedbb926ac20f0f920a Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. Jul 12 14:42:33.468835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '79871b04-6603-485a-82e7-bbcd6dbf65dd'} Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:33.469741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. Jul 12 14:42:33.471775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.472961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Returning 404 to user: Instance 79871b04-6603-485a-82e7-bbcd6dbf65dd could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:33.472961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-21d874e8-f91f-44f1-b59e-71b63ce5872f tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd" status: 404 len: 111 microversion: 2.1 time: 0.030159 Jul 12 14:42:33.472961 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 495/1008] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/79871b04-6603-485a-82e7-bbcd6dbf65dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:42:33.514254 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.514870 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.521917 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.522364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.523131 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.523582 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.653874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:33.661964 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5f38b390-745a-4938-89bd-0cdb9f09d1d6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1654 microversion: 2.1 time: 0.151622 Jul 12 14:42:33.662530 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 514/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:33.678595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4408ff74-ac82-4edd-a935-25601e228809 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:33.684557 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4408ff74-ac82-4edd-a935-25601e228809 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.685005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4408ff74-ac82-4edd-a935-25601e228809 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.707492 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4408ff74-ac82-4edd-a935-25601e228809 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Going to try to start instance {{(pid=124549) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 14:42:33.748971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4408ff74-ac82-4edd-a935-25601e228809 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action" status: 202 len: 0 microversion: 2.1 time: 0.074161 Jul 12 14:42:33.749618 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 496/1010] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:33 2022] POST /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:33.758248 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.758890 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.765357 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.765872 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.766720 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.767759 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.925659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.926279 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.933809 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.934390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.935578 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.935954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.945360 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:33.952404 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] HTTP exception thrown: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.953105 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d3f6abb1-a64c-4df4-ad82-a9021122c2c7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1663 microversion: 2.1 time: 0.198965 Jul 12 14:42:33.953935 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 515/1011] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1663 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Request method failure captured: Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: DELETE /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 HTTP/1.1 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYZ0cS-Kp42Co_vYPLUf7knWNAYoqaZ4cY2PF5dAW9XCYRTpAGds_KtJwfrXARDxaV-yDRYlGmiSjfEDREqz2Rf6_IEYXbRUzoaqrentRu_68WNmkkTFpYpyTmBnCEoWgE5aCKH36VWxRx3rFq0fgAHa_nIF9tMaUzvVcjKBAyPt8jc Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:42:33.955341 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aac705367c454623a23f11bfa8d25756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aac705367c454623a23f11bfa8d25756", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 42165c1e1b324fedbb926ac20f0f920a Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.956834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '82caa470-858f-4885-aff4-ee0bbea62417'} Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:33.957678 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.958969 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.960254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Returning 404 to user: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:33.960254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-92d8ea0b-5199-404c-b888-b74158fc0458 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 404 len: 111 microversion: 2.1 time: 0.036008 Jul 12 14:42:33.960254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 497/1012] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:42:33 2022] DELETE /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:42:33.967658 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:33.968354 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] [instance: 82caa470-858f-4885-aff4-ee0bbea62417] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:33.975056 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.975509 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.976280 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:33.976717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:33.991235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] HTTP exception thrown: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Request method failure captured: Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 HTTP/1.1 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYZ0cS-Kp42Co_vYPLUf7knWNAYoqaZ4cY2PF5dAW9XCYRTpAGds_KtJwfrXARDxaV-yDRYlGmiSjfEDREqz2Rf6_IEYXbRUzoaqrentRu_68WNmkkTFpYpyTmBnCEoWgE5aCKH36VWxRx3rFq0fgAHa_nIF9tMaUzvVcjKBAyPt8jc Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:42:33.992912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aac705367c454623a23f11bfa8d25756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aac705367c454623a23f11bfa8d25756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aac705367c454623a23f11bfa8d25756", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: aac705367c454623a23f11bfa8d25756 Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestVolumeBootPattern-1861362067 Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 42165c1e1b324fedbb926ac20f0f920a Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestVolumeBootPattern-1861362067-project Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.994642 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '82caa470-858f-4885-aff4-ee0bbea62417'} Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:33.998862 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. Jul 12 14:42:34.000382 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:34.002335 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Returning 404 to user: Instance 82caa470-858f-4885-aff4-ee0bbea62417 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:34.002335 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a0efccdb-a7ac-47e9-93ed-12470754dd2e tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417" status: 404 len: 111 microversion: 2.1 time: 0.030484 Jul 12 14:42:34.002335 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 516/1013] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:33 2022] GET /compute/v2.1/servers/82caa470-858f-4885-aff4-ee0bbea62417 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 14:42:34.969472 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:34.970639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:34.977146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:34.977619 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:34.978369 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:34.978808 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:35.106380 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:35.114006 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e6da6a2e-158d-4e27-9acd-49cf88d0beb9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1663 microversion: 2.1 time: 0.148403 Jul 12 14:42:35.114666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 498/1014] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:34 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:35.297184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-9b409607-4369-4116-8c3e-35eb25612a51 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] Calling method '.version_select at 0x7f01caa47430>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:35.319834 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-9b409607-4369-4116-8c3e-35eb25612a51 tempest-TestVolumeBootPattern-1861362067 tempest-TestVolumeBootPattern-1861362067-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1989063543" status: 202 len: 0 microversion: 2.1 time: 0.026399 Jul 12 14:42:35.320409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 517/1015] 10.222.0.25 () {58 vars in 1262 bytes} [Tue Jul 12 14:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1989063543 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:36.131671 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:36.132403 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:36.139371 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:36.139817 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:36.140591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:36.141021 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:36.278840 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:36.286348 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4cc386be-3a6b-4498-92c1-c642dba43530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1667 microversion: 2.1 time: 0.158665 Jul 12 14:42:36.286915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 499/1016] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:36 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:40.286366 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:42:40.286930 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:42:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:42:48.767122 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=24 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.767906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.771955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1154248452"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:48.772482 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:48.780700 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:48.781142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:48.782519 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:48.782955 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:48.909309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.network.security_group_api [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Removing security group ccf52f21-aa97-4c6f-8c61-0f21b02b6b74 from port e85e127d-8daa-4def-ba93-910bf3970543 Jul 12 14:42:49.247447 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-11f86eaf-58fc-4c2f-b378-99fa090b0b96 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action" status: 202 len: 0 microversion: 2.1 time: 0.482117 Jul 12 14:42:49.251390 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 518/1017] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Jul 12 14:42:48 2022] POST /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:49.256167 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-2c96df95-866f-44ca-ac96-fc4331e13c14 req-ee7a795b-eab3-4fe8-bbc4-d6c3aa12ab08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:49.260597 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=13 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:49.261430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:49.279208 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2c96df95-866f-44ca-ac96-fc4331e13c14 req-ee7a795b-eab3-4fe8-bbc4-d6c3aa12ab08 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:49.279663 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-2c96df95-866f-44ca-ac96-fc4331e13c14 req-ee7a795b-eab3-4fe8-bbc4-d6c3aa12ab08 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:49.302274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-2c96df95-866f-44ca-ac96-fc4331e13c14 req-ee7a795b-eab3-4fe8-bbc4-d6c3aa12ab08 service nova] Creating event network-changed:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:42:49.313105 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-2c96df95-866f-44ca-ac96-fc4331e13c14 req-ee7a795b-eab3-4fe8-bbc4-d6c3aa12ab08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060881 Jul 12 14:42:49.314027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 500/1018] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:50.979419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:50.979927 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:50.986561 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:50.987020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:50.987795 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:50.988235 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.068115 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lazy-loading 'services' on Instance uuid f9885235-23eb-447f-bedd-c3a61b926af3 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:42:51.142053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-086b0e32-2a16-401f-9020-ba27308386d4 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments/e2a8753e-1379-4271-856b-abfb94560609" status: 202 len: 0 microversion: 2.1 time: 0.166437 Jul 12 14:42:51.142760 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 519/1019] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:42:50 2022] DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments/e2a8753e-1379-4271-856b-abfb94560609 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:42:51.152669 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:51.154454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:51.166390 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.166982 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.167936 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.168448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.201552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-a326289e-4438-4c71-be24-c93dee555fdc tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053585 Jul 12 14:42:51.202031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 501/1020] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:42:51 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:42:51.328221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-4c8b8938-6dd1-41cd-a2e1-a11bed75529d req-a92ef8e0-58d0-4455-8ef1-53c72a64c242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:51.337266 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4c8b8938-6dd1-41cd-a2e1-a11bed75529d req-a92ef8e0-58d0-4455-8ef1-53c72a64c242 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:51.337742 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-4c8b8938-6dd1-41cd-a2e1-a11bed75529d req-a92ef8e0-58d0-4455-8ef1-53c72a64c242 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:51.348415 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-4c8b8938-6dd1-41cd-a2e1-a11bed75529d req-a92ef8e0-58d0-4455-8ef1-53c72a64c242 service nova] Creating event network-changed:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:42:51.353254 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-4c8b8938-6dd1-41cd-a2e1-a11bed75529d req-a92ef8e0-58d0-4455-8ef1-53c72a64c242 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029065 Jul 12 14:42:51.354059 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 520/1021] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:52.212743 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:52.213726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:52.220892 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.221353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.222146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.222580 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.251289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7f9cbde6-1c92-4fc0-8e35-45714a04b643 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042079 Jul 12 14:42:52.251835 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 502/1022] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:42:52 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:42:52.262762 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:52.263459 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:52.269951 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.270366 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.271126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:52.271555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:52.345351 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] HTTP exception thrown: Instance f9885235-23eb-447f-bedd-c3a61b926af3 is not attached to volume e2a8753e-1379-4271-856b-abfb94560609 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Request method failure captured: Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments/e2a8753e-1379-4271-856b-abfb94560609 HTTP/1.1 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYfyuzRqmcQ0To22_r_0iwqb74ED4gjt294tFm36-Sv_oYLxcWAU0bh7-sLBI3R2mTvr_gu45p-cJB8fu9N5CbYjhKKw7uOXxrIQRPgHMvoccY7IMepr-eN9Dvg3JByXqvoGiyhORPGsUo0q81LIzg_kEVGWI5gCCRcQDoj3bMHl1m4 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 51b448bb6d0542e9aeb90961739d9c06 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:42:52.347716 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b448bb6d0542e9aeb90961739d9c06", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 51b448bb6d0542e9aeb90961739d9c06 Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-TestMinimumBasicScenario-2145304438-project Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 2a821209feb04c0a9f67aa6dfe7fb1e9 Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-TestMinimumBasicScenario-2145304438-project Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:42:52.349492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance f9885235-23eb-447f-bedd-c3a61b926af3 is not attached to volume e2a8753e-1379-4271-856b-abfb94560609 Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'server_id': 'f9885235-23eb-447f-bedd-c3a61b926af3', 'id': 'e2a8753e-1379-4271-856b-abfb94560609'} Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e2a8753e-1379-4271-856b-abfb94560609. Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:52.350496 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9885235-23eb-447f-bedd-c3a61b926af3 is not attached to volume e2a8753e-1379-4271-856b-abfb94560609 Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9885235-23eb-447f-bedd-c3a61b926af3 is not attached to volume e2a8753e-1379-4271-856b-abfb94560609 Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:42:52.352087 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Returning 404 to user: Instance f9885235-23eb-447f-bedd-c3a61b926af3 is not attached to volume e2a8753e-1379-4271-856b-abfb94560609 {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:52.353554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-36ba1f1f-0a2c-4f39-8b62-61224710e9e5 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments/e2a8753e-1379-4271-856b-abfb94560609" status: 404 len: 154 microversion: 2.1 time: 0.091202 Jul 12 14:42:52.353554 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 521/1023] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:42:52 2022] DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3/os-volume_attachments/e2a8753e-1379-4271-856b-abfb94560609 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:42:53.482350 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:53.482862 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:53.490079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:53.490525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:53.491284 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:53.491714 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:53.515205 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:42:53.587222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b12539fc-8486-46ce-bb57-d1af9505ac9b tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 204 len: 0 microversion: 2.1 time: 0.108564 Jul 12 14:42:53.587926 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 503/1024] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:42:53 2022] DELETE /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:42:53.597251 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:53.598032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:53.604985 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:53.605468 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:53.606241 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:53.606675 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:53.739695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:53.747190 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-2be2b844-ab66-4ce5-b3db-635ae6fb159a tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1553 microversion: 2.1 time: 0.154272 Jul 12 14:42:53.747752 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 522/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:53 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:54.764990 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:54.765726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:54.772153 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:54.772599 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:54.773379 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:54.773816 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:54.907414 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:54.914934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-30e86c56-802e-4632-a22f-2a5aeac5d0c3 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1553 microversion: 2.1 time: 0.154130 Jul 12 14:42:54.915496 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 504/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:54 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:42:55.932159 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:55.932896 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:55.940304 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:55.940858 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:55.941596 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:55.942555 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:56.012904 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a821209feb04c0a9f67aa6dfe7fb1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b448bb6d0542e9aeb90961739d9c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:42:56.022543 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6bc4515c-4249-43e1-8f95-a7397d4da526 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 200 len: 1343 microversion: 2.1 time: 0.094307 Jul 12 14:42:56.024554 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 505/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:55 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 1343 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:42:56.059654 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-e02830da-4058-4dbc-aebe-b97b5f6295fe req-469b9064-14da-4b54-9ce8-7b9e56ce3307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9885235-23eb-447f-bedd-c3a61b926af3", "name": "network-vif-deleted", "tag": "e85e127d-8daa-4def-ba93-910bf3970543"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:42:56.068680 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e02830da-4058-4dbc-aebe-b97b5f6295fe req-469b9064-14da-4b54-9ce8-7b9e56ce3307 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:56.069169 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-e02830da-4058-4dbc-aebe-b97b5f6295fe req-469b9064-14da-4b54-9ce8-7b9e56ce3307 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:56.082102 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-e02830da-4058-4dbc-aebe-b97b5f6295fe req-469b9064-14da-4b54-9ce8-7b9e56ce3307 service nova] Creating event network-vif-deleted:e85e127d-8daa-4def-ba93-910bf3970543 for instance f9885235-23eb-447f-bedd-c3a61b926af3 on hv-cinder-83699 Jul 12 14:42:56.087257 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-e02830da-4058-4dbc-aebe-b97b5f6295fe req-469b9064-14da-4b54-9ce8-7b9e56ce3307 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178578 Jul 12 14:42:56.087906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 523/1028] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:42:57.040874 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:57.041534 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] [instance: f9885235-23eb-447f-bedd-c3a61b926af3] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:42:57.048084 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:57.048538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:57.049310 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:42:57.049780 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:42:57.063271 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] HTTP exception thrown: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Request method failure captured: Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 HTTP/1.1 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYfyuzRqmcQ0To22_r_0iwqb74ED4gjt294tFm36-Sv_oYLxcWAU0bh7-sLBI3R2mTvr_gu45p-cJB8fu9N5CbYjhKKw7uOXxrIQRPgHMvoccY7IMepr-eN9Dvg3JByXqvoGiyhORPGsUo0q81LIzg_kEVGWI5gCCRcQDoj3bMHl1m4 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 51b448bb6d0542e9aeb90961739d9c06 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:42:57.064897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/51b448bb6d0542e9aeb90961739d9c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_51b448bb6d0542e9aeb90961739d9c06", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 51b448bb6d0542e9aeb90961739d9c06 Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2145304438 Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-TestMinimumBasicScenario-2145304438-project Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 2a821209feb04c0a9f67aa6dfe7fb1e9 Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-TestMinimumBasicScenario-2145304438-project Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. Jul 12 14:42:57.066823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': 'f9885235-23eb-447f-bedd-c3a61b926af3'} Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:42:57.067838 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. Jul 12 14:42:57.069246 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:42:57.070954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Returning 404 to user: Instance f9885235-23eb-447f-bedd-c3a61b926af3 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:42:57.070954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8190c992-5f61-472c-b386-ed36a09ac65e tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3" status: 404 len: 111 microversion: 2.1 time: 0.029947 Jul 12 14:42:57.070954 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 506/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:42:57 2022] GET /compute/v2.1/servers/f9885235-23eb-447f-bedd-c3a61b926af3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:42:57.076221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a80c9318-15bb-49f2-bc1d-4a581b7c89e0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] Calling method '.version_select at 0x7f01d312e040>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:42:57.094520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a80c9318-15bb-49f2-bc1d-4a581b7c89e0 tempest-TestMinimumBasicScenario-2145304438 tempest-TestMinimumBasicScenario-2145304438-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924437884" status: 202 len: 0 microversion: 2.1 time: 0.022795 Jul 12 14:42:57.095798 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 524/1030] 10.222.0.25 () {58 vars in 1268 bytes} [Tue Jul 12 14:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924437884 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:43:08.556983 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:08.558094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:08.560715 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:08.561375 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:08.569241 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.569710 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.570471 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.570899 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.605916 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-15030ad7-31ac-473c-8cf3-79c0c2d4d25b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052828 Jul 12 14:43:08.606480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 507/1031] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:43:08 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:43:08.661695 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:08.662430 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:08.666718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:08.667300 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:08.676774 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.677221 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.678014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.678451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.703932 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:43:08.780693 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bcb9c35e-4a67-4d36-b0c8-59fec74970d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 204 len: 0 microversion: 2.1 time: 0.119994 Jul 12 14:43:08.781793 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 525/1032] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:43:08 2022] DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:43:08.789594 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:08.790216 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:08.796138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.797087 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.797907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:08.798337 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:08.935832 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:08.943659 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-964547b2-7488-4d48-818b-8827d4eca3e3 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1673 microversion: 2.1 time: 0.157925 Jul 12 14:43:08.944223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 508/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:08 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:09.962361 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:09.963068 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:09.970024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.970477 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:09.971244 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:09.971682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:10.103567 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:10.113004 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-30a68348-d3a2-42af-95f0-c2bd5ebe2755 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1673 microversion: 2.1 time: 0.154759 Jul 12 14:43:10.113856 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 526/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:09 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 14:43:11.129883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:11.130601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:11.137005 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.137497 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.138264 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.138696 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.271080 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:11.278608 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-8036c3fd-217e-41e0-92a8-103ef1eeb64c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 200 len: 1673 microversion: 2.1 time: 0.152637 Jul 12 14:43:11.279180 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 509/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:11 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:11.660063 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-cebc7e6a-7288-48ca-a2b8-cf09f07c6eda req-450d9cc1-7d2b-436f-b829-53819f510881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883d95d2-8ecc-4d09-baa8-3f5d1949ddc4", "name": "network-vif-deleted", "tag": "dfc911b7-45fc-41d3-975b-064cdd6310bc"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:11.670144 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-cebc7e6a-7288-48ca-a2b8-cf09f07c6eda req-450d9cc1-7d2b-436f-b829-53819f510881 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:11.670590 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-cebc7e6a-7288-48ca-a2b8-cf09f07c6eda req-450d9cc1-7d2b-436f-b829-53819f510881 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:11.683409 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-cebc7e6a-7288-48ca-a2b8-cf09f07c6eda req-450d9cc1-7d2b-436f-b829-53819f510881 service nova] Creating event network-vif-deleted:dfc911b7-45fc-41d3-975b-064cdd6310bc for instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 on hv-cinder-83699 Jul 12 14:43:11.689508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-cebc7e6a-7288-48ca-a2b8-cf09f07c6eda req-450d9cc1-7d2b-436f-b829-53819f510881 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Jul 12 14:43:11.690566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 527/1036] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:12.295949 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:12.296657 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:12.303143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:12.303639 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:12.304411 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:12.304845 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:12.318987 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 HTTP/1.1 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:43:12.320469 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:43:12.322274 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '883d95d2-8ecc-4d09-baa8-3f5d1949ddc4'} Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:43:12.323204 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:43:12.324822 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:43:12.326233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:43:12.326233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4ab87d8a-352f-428f-a02f-ae1946041197 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 404 len: 111 microversion: 2.1 time: 0.029923 Jul 12 14:43:12.326233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 510/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:12 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:43:12.331829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-20f55d96-f081-4450-8a9f-21f855ece32a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '.version_select at 0x7f01d31828b0>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:12.349643 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-20f55d96-f081-4450-8a9f-21f855ece32a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749149887" status: 202 len: 0 microversion: 2.1 time: 0.022502 Jul 12 14:43:12.350238 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 528/1038] 10.222.0.25 () {58 vars in 1217 bytes} [Tue Jul 12 14:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749149887 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:43:12.997823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5ac784d5-5104-4d37-ad84-bc3361e027e1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: .version_select at 0x7f01ce9af4c0>, body: {"keypair": {"name": "tempest-keypair-1488254189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuWlyRvO4XBN9FTrUii9gm3SzWlMuILgNwA+aKE8KCYpLsmrWuqZh5K3Qd45qp1m0XDecjzmY27h1ofPkU+AVgwMDAr5GYg6jvhSojaXGTiy80cH3D/55fvOmi00bH6zA=="}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:13.012648 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-5ac784d5-5104-4d37-ad84-bc3361e027e1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:13.016462 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-5ac784d5-5104-4d37-ad84-bc3361e027e1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for user 64206d561ee4456a8f8c670dfd2944a5 and project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'key_pairs'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:13.041096 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5ac784d5-5104-4d37-ad84-bc3361e027e1 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047143 Jul 12 14:43:13.041739 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 511/1039] 10.222.0.25 () {60 vars in 1158 bytes} [Tue Jul 12 14:43:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:14.305584 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1815653811", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "648b017d-bc88-43ee-8595-cdd86bb231e6"}], "security_groups": [{"name": "tempest-securitygroup--1695987314"}], "key_name": "tempest-keypair-1488254189", "user_data": "}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:14.412841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] validate_networks() for [('648b017d-bc88-43ee-8595-cdd86bb231e6', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:43:15.144081 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:43:15.144465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:43:15.145005 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:43:15.146024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:43:15.146024 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:43:15.155099 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.155545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.156984 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:15.157371 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:15.174874 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:43:15.179011 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Getting quotas for user 64206d561ee4456a8f8c670dfd2944a5 and project 0d418ed7f92744978dd6a9f1f77287c5. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:43:15.193314 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:43:15.195885 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:43:15.244182 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d91bb189-1356-4185-b38c-42fdb0fdcf81 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943464 Jul 12 14:43:15.244844 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 529/1040] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:43:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:43:15.255724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-dc5af16b-272c-4fe1-af9b-76aa6cbe15f7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:15.256377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-dc5af16b-272c-4fe1-af9b-76aa6cbe15f7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:15.311463 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-dc5af16b-272c-4fe1-af9b-76aa6cbe15f7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:15.319107 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-dc5af16b-272c-4fe1-af9b-76aa6cbe15f7 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1238 microversion: 2.1 time: 0.067782 Jul 12 14:43:15.319673 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 512/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:15 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:16.336995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:16.337784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:16.346527 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:16.347359 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:16.348441 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:16.349143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:16.428800 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:16.437353 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-146cb222-84a4-4180-8992-c1d69d3c4881 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1308 microversion: 2.1 time: 0.104744 Jul 12 14:43:16.441395 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 530/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:16 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:17.454302 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:17.454962 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:17.461254 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.461730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.462498 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.462941 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.602717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:17.611227 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-f6bee47c-e2e0-4807-9572-cff5f7cd8530 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.160608 Jul 12 14:43:17.612560 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 513/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:17 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:17.749818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-318c22bd-aef6-4d3b-867a-193dd40129b2 req-7025a01c-e122-4285-b6af-35aca16df8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea04387-8cbe-4b8c-add0-f74e8ee90505", "tag": "163c811a-4315-41cf-bf63-a0d5928c7050"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:17.766464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-318c22bd-aef6-4d3b-867a-193dd40129b2 req-7025a01c-e122-4285-b6af-35aca16df8f8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:17.767317 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-318c22bd-aef6-4d3b-867a-193dd40129b2 req-7025a01c-e122-4285-b6af-35aca16df8f8 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:17.780020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-318c22bd-aef6-4d3b-867a-193dd40129b2 req-7025a01c-e122-4285-b6af-35aca16df8f8 service nova] Creating event network-changed:163c811a-4315-41cf-bf63-a0d5928c7050 for instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 on hv-cinder-83699 Jul 12 14:43:17.785098 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-318c22bd-aef6-4d3b-867a-193dd40129b2 req-7025a01c-e122-4285-b6af-35aca16df8f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039094 Jul 12 14:43:17.785734 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 531/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:18.627953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:18.628569 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:18.635180 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.635629 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.636389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:18.636824 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:18.767138 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:18.774595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-fd1f3ff6-b9f9-44f2-a18f-29252327c239 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.150576 Jul 12 14:43:18.775152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 514/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:18 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:19.792228 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:19.792922 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:19.800256 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.800708 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.801508 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:19.801944 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:19.931727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:19.939095 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-246da9b2-a1ed-4c3b-bc0a-d0dcc7dfa78d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.151105 Jul 12 14:43:19.939650 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 532/1046] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:19 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:20.956393 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:20.957037 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:20.963528 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.963975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:20.964730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:20.965161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:21.091716 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:21.099579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1e13394c-bff9-401a-be46-8f50f830f96b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.147574 Jul 12 14:43:21.100136 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 515/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:20 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:22.115989 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:22.116594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:22.123077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:22.123465 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.124767 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:22.125199 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:22.252480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:22.259893 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-f5b7f6b2-89f9-47f9-93d0-79f1e5850263 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.147724 Jul 12 14:43:22.260458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 533/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:22 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:23.276564 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:23.277176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:23.283781 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.284232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.284993 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.285458 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.412592 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:23.420253 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b9fbb7a1-acd8-446f-8674-4c1e9d1cff3a tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.147482 Jul 12 14:43:23.420819 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 516/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:23 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:23.596102 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-b0426b7a-6a16-49dd-a579-a4553579eac4 req-d12c50dc-ea2b-484c-b23b-81e39ace0386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea04387-8cbe-4b8c-add0-f74e8ee90505", "name": "network-vif-plugged", "status": "completed", "tag": "163c811a-4315-41cf-bf63-a0d5928c7050"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:23.604977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b0426b7a-6a16-49dd-a579-a4553579eac4 req-d12c50dc-ea2b-484c-b23b-81e39ace0386 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:23.605479 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-b0426b7a-6a16-49dd-a579-a4553579eac4 req-d12c50dc-ea2b-484c-b23b-81e39ace0386 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:23.617192 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-b0426b7a-6a16-49dd-a579-a4553579eac4 req-d12c50dc-ea2b-484c-b23b-81e39ace0386 service nova] Creating event network-vif-plugged:163c811a-4315-41cf-bf63-a0d5928c7050 for instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 on hv-cinder-83699 Jul 12 14:43:23.622007 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-b0426b7a-6a16-49dd-a579-a4553579eac4 req-d12c50dc-ea2b-484c-b23b-81e39ace0386 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030129 Jul 12 14:43:23.622591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 534/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:24.438047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:24.438677 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:24.445445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.445898 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:24.446660 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:24.447094 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:24.580419 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:24.588233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-dc4fca58-d749-4b93-97fe-c78f463db54b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1364 microversion: 2.1 time: 0.154733 Jul 12 14:43:24.588796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 517/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:24 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:25.603021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:25.603784 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:25.607925 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:25.609220 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:25.616271 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.616718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.617528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.617966 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.745223 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:43:25.753103 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-880b60f5-a4c7-403b-8cc0-9c83e287975b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1551 microversion: 2.1 time: 0.151398 Jul 12 14:43:25.753780 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 535/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:43:25 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:43:25.769055 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:25.769601 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:25.771491 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:25.777177 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.777653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.778425 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:25.778864 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:25.855859 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-6606d884-3eee-4fe6-8891-40d60e178275 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090537 Jul 12 14:43:25.856461 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 518/1053] 10.222.0.25 () {58 vars in 1274 bytes} [Tue Jul 12 14:43:25 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:26.903812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-ea163706-862c-4d68-aa96-4f8b6833fd50 req-5dade9da-b444-4079-a513-eaa83f146802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea04387-8cbe-4b8c-add0-f74e8ee90505", "tag": "163c811a-4315-41cf-bf63-a0d5928c7050"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:43:26.912548 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ea163706-862c-4d68-aa96-4f8b6833fd50 req-5dade9da-b444-4079-a513-eaa83f146802 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:26.913000 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-ea163706-862c-4d68-aa96-4f8b6833fd50 req-5dade9da-b444-4079-a513-eaa83f146802 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:26.923735 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-ea163706-862c-4d68-aa96-4f8b6833fd50 req-5dade9da-b444-4079-a513-eaa83f146802 service nova] Creating event network-changed:163c811a-4315-41cf-bf63-a0d5928c7050 for instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 on hv-cinder-83699 Jul 12 14:43:26.928722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-ea163706-862c-4d68-aa96-4f8b6833fd50 req-5dade9da-b444-4079-a513-eaa83f146802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151764 Jul 12 14:43:26.929594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 536/1054] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:43:58.693653 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:58.694456 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=54 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:58.698512 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:43:58.699002 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:43:58.706664 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.707117 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.707883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:43:58.708317 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:43:58.730903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-80d43788-d7d0-4658-ad43-638e942423af tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/ips" status: 200 len: 146 microversion: 2.1 time: 0.038782 Jul 12 14:43:58.731480 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 519/1055] 10.222.0.25 () {58 vars in 1247 bytes} [Tue Jul 12 14:43:58 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:00.042738 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10e57c49-be36-48ef-a97d-4d79c107b725"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:00.043880 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:00.046524 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:00.047152 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:00.053280 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.053814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.054568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:00.054997 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:00.314194 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-72cdb822-e412-4cbe-add6-34d03d291ffc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275267 Jul 12 14:44:00.319184 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 537/1056] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:44:00 2022] POST /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:44:07.788521 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:07.789535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:07.795903 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.796353 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.797103 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.797634 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.826612 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-1bd46e02-edcf-4900-b2b8-b47323b7d60d tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 12 14:44:07.827144 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 520/1057] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:07 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:07.838234 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:07.838830 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:07.844913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.845379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.846134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:07.846566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:07.874753 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8c9d0ad7-7c1f-4e4f-ab5f-8450d3b86131 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725" status: 200 len: 194 microversion: 2.1 time: 0.041335 Jul 12 14:44:07.875322 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 538/1058] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 14:44:07 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:09.182535 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10dd18a0-974d-4e0a-ae9f-ac1369ded9a0"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:09.183538 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:09.190878 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:09.191330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:09.192098 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:09.192537 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:09.449761 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e30c7ded-58bc-4abf-a92c-ca45859e53fb tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "POST /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271030 Jul 12 14:44:09.450959 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 521/1059] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:44:09 2022] POST /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:16.929751 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:16.930676 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:16.937181 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:16.937660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:16.938417 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:16.938845 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:16.968379 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e01678be-9955-496d-973a-4240c3e02630 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042526 Jul 12 14:44:16.968913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 539/1060] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:16 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:17.112403 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:17.112983 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:17.119213 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.119666 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.120430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.120869 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.149709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0038cd6c-7498-48fd-9626-8d00d1dc2985 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725" status: 200 len: 194 microversion: 2.1 time: 0.042231 Jul 12 14:44:17.150289 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 522/1061] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 14:44:17 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:17.160442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:17.160938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:17.166827 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.167273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.168028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:17.168462 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:17.247332 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lazy-loading 'services' on Instance uuid 3ea04387-8cbe-4b8c-add0-f74e8ee90505 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:17.319992 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-98b33852-e892-4aa4-8d4a-d40004fd874b tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725" status: 202 len: 0 microversion: 2.1 time: 0.163318 Jul 12 14:44:17.320566 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 540/1062] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:44:17 2022] DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10e57c49-be36-48ef-a97d-4d79c107b725 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:18.431441 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.431973 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.438495 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.438928 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.439952 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.440389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.468895 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0e9eef59-9bc9-4ab5-8f1b-a94b28c3f90c tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10dd18a0-974d-4e0a-ae9f-ac1369ded9a0" status: 200 len: 194 microversion: 2.1 time: 0.041464 Jul 12 14:44:18.469489 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 523/1063] 10.222.0.25 () {58 vars in 1412 bytes} [Tue Jul 12 14:44:18 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10dd18a0-974d-4e0a-ae9f-ac1369ded9a0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:18.480269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:18.480850 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:18.487539 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.487993 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.488832 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:18.489264 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:18.568842 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lazy-loading 'services' on Instance uuid 3ea04387-8cbe-4b8c-add0-f74e8ee90505 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:44:18.639591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5b4b4320-e959-4cb3-813e-bd3bb0a984b8 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10dd18a0-974d-4e0a-ae9f-ac1369ded9a0" status: 202 len: 0 microversion: 2.1 time: 0.163927 Jul 12 14:44:18.640466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 541/1064] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:44:18 2022] DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments/10dd18a0-974d-4e0a-ae9f-ac1369ded9a0 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:19.797686 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:19.798631 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:19.805140 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.805637 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.806412 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.806848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.835676 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-68b630e6-5862-4a72-894d-ed40f37a87b5 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042648 Jul 12 14:44:19.836222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 524/1065] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:19 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:44:19.939161 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:19.940480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:19.946655 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.947097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.947851 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:19.948279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:19.976719 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-3a1ada8a-317f-4c1c-8592-7353c98a8646 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042218 Jul 12 14:44:19.977193 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 542/1066] 10.222.0.25 () {58 vars in 1301 bytes} [Tue Jul 12 14:44:19 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 14:44:20.031709 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:20.032202 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:20.038079 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.038526 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.039293 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.039724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.064810 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:44:20.136882 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7f21a590-bb3a-4943-b046-188826f577cc tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 204 len: 0 microversion: 2.1 time: 0.108724 Jul 12 14:44:20.137598 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 525/1067] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:20 2022] DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:44:20.146002 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:20.146639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:20.153084 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.153594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.154571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:20.154980 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:20.291660 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:20.299560 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-8a654511-cb5e-4e61-8670-76baa0882aca tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1675 microversion: 2.1 time: 0.157381 Jul 12 14:44:20.300113 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 543/1068] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:20 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:21.317222 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:21.317943 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:21.324367 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.324813 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:21.326143 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:21.326576 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:21.458180 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:21.465934 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4de2f5a9-6b1f-4a68-97b6-ea93b7a8c471 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1675 microversion: 2.1 time: 0.153038 Jul 12 14:44:21.466529 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 526/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:21 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:22.484347 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:22.485109 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:22.491644 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.492097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.492869 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:22.493301 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:22.693698 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64206d561ee4456a8f8c670dfd2944a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d418ed7f92744978dd6a9f1f77287c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:44:22.701255 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-0ea4b838-17d1-49d6-999a-14dc5c75d340 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 200 len: 1675 microversion: 2.1 time: 0.221184 Jul 12 14:44:22.701860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 544/1070] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:22 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:44:23.081298 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-ec6c8c20-0378-4be1-acea-d0403f4ebc26 req-d5492b89-4fa9-4942-b954-0745027b3265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea04387-8cbe-4b8c-add0-f74e8ee90505", "name": "network-vif-deleted", "tag": "163c811a-4315-41cf-bf63-a0d5928c7050"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:44:23.089948 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ec6c8c20-0378-4be1-acea-d0403f4ebc26 req-d5492b89-4fa9-4942-b954-0745027b3265 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.090389 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-ec6c8c20-0378-4be1-acea-d0403f4ebc26 req-d5492b89-4fa9-4942-b954-0745027b3265 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.103054 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-ec6c8c20-0378-4be1-acea-d0403f4ebc26 req-d5492b89-4fa9-4942-b954-0745027b3265 service nova] Creating event network-vif-deleted:163c811a-4315-41cf-bf63-a0d5928c7050 for instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 on hv-cinder-83699 Jul 12 14:44:23.108595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-ec6c8c20-0378-4be1-acea-d0403f4ebc26 req-d5492b89-4fa9-4942-b954-0745027b3265 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 Jul 12 14:44:23.111975 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 527/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:44:23.719053 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:23.719814 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:23.726364 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.726818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.727594 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:23.728036 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:23.742266 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 HTTP/1.1 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:44:23.743931 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:23.745611 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '3ea04387-8cbe-4b8c-add0-f74e8ee90505'} Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:23.746466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:23.747812 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:23.749151 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:23.749151 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-a651da50-8cce-4da9-bdbc-c57b8e166660 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 404 len: 111 microversion: 2.1 time: 0.030953 Jul 12 14:44:23.749151 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 545/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:23 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:23.755503 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-0575718b-a1b4-4504-a594-f1efccde01d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '.version_select at 0x7f01ce9afa60>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:23.773294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-0575718b-a1b4-4504-a594-f1efccde01d9 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488254189" status: 202 len: 0 microversion: 2.1 time: 0.021892 Jul 12 14:44:23.773883 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 528/1073] 10.222.0.25 () {58 vars in 1220 bytes} [Tue Jul 12 14:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488254189 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:44:26.645906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:26.646413 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:26.653461 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.653918 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.654685 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.655125 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.668273 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 HTTP/1.1 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:44:26.670378 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.672126 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '3ea04387-8cbe-4b8c-add0-f74e8ee90505'} Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:26.673279 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.674995 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.676607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:26.676607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fe2c3756-668b-48ae-a282-02dfbd2c5168 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 404 len: 111 microversion: 2.1 time: 0.029864 Jul 12 14:44:26.676607 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 546/1074] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:26 2022] DELETE /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:26.680496 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:26.681251 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 3ea04387-8cbe-4b8c-add0-f74e8ee90505] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:26.687915 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.688385 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.689144 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:26.689856 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:26.703296 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 HTTP/1.1 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:44:26.704953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.706685 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '3ea04387-8cbe-4b8c-add0-f74e8ee90505'} Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:26.707738 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. Jul 12 14:44:26.709325 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:26.710756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 3ea04387-8cbe-4b8c-add0-f74e8ee90505 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:26.710756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-57ad3b45-b9e4-4ab1-95b8-4414c0800ad6 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505" status: 404 len: 111 microversion: 2.1 time: 0.029781 Jul 12 14:44:26.710756 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 529/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:26 2022] GET /compute/v2.1/servers/3ea04387-8cbe-4b8c-add0-f74e8ee90505 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:27.838755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:27.839252 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:27.845900 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.846345 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.847097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.847526 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.860471 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 HTTP/1.1 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:44:27.862019 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.863638 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '883d95d2-8ecc-4d09-baa8-3f5d1949ddc4'} Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:27.864569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.865913 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.867269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:27.867269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fc841863-3951-4e3a-a154-b48c98112254 tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 404 len: 111 microversion: 2.1 time: 0.028515 Jul 12 14:44:27.867269 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 547/1076] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:44:27 2022] DELETE /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:27.872233 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:44:27.872851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] [instance: 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:44:27.879292 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.879767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.880525 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:44:27.880957 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:44:27.894579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] HTTP exception thrown: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Request method failure captured: Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 HTTP/1.1 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYfLoJyeg9lZcBCVQvGDx6HM231I1CUqxhhky3fLeHfzRayFRQnJjhhxMX5s35a3REP5q3fvnJEmTqzUAM4h59KMVJlizH3tzWxjvXveBzvcBWPXMN_mwnNKW4gyPeDSHA4nrfW36R2YyfO8I_FBkiX5VdWhedAzBOXCUeorQn0Ahmg Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:44:27.896065 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0d418ed7f92744978dd6a9f1f77287c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0d418ed7f92744978dd6a9f1f77287c5", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: 0d418ed7f92744978dd6a9f1f77287c5 Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974298267 Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 64206d561ee4456a8f8c670dfd2944a5 Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-AttachVolumeTestJSON-1974298267-project Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.897706 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '883d95d2-8ecc-4d09-baa8-3f5d1949ddc4'} Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:44:27.898636 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. Jul 12 14:44:27.900165 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:44:27.901796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] Returning 404 to user: Instance 883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:44:27.901796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-23d2d2d1-8040-4aa6-9f4e-bf6d272cef6e tempest-AttachVolumeTestJSON-1974298267 tempest-AttachVolumeTestJSON-1974298267-project] 10.222.0.25 "GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4" status: 404 len: 111 microversion: 2.1 time: 0.029521 Jul 12 14:44:27.901796 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 530/1077] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:44:27 2022] GET /compute/v2.1/servers/883d95d2-8ecc-4d09-baa8-3f5d1949ddc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:50.005562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:45:50.006094 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:45:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:45:51.364417 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=22 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:51.365157 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:51.370277 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-631729198", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "networks": [{"uuid": "ca67d2a4-8a1b-4d39-bc20-55e6141b0a9d"}]}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:51.425458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.network.neutron [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] validate_networks() for [('ca67d2a4-8a1b-4d39-bc20-55e6141b0a9d', None, None, None, None, None)] {{(pid=124550) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:45:51.767404 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Flavor limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:45:51.767833 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Image limits 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:45:51.768309 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Flavor pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:45:51.768721 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Image pref 0:0:0 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:45:51.769134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.virt.hardware [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124550) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:45:51.778649 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:51.779102 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:51.779910 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:51.780385 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:51.796907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Getting quotas for project f5422e72a4e64b30af144dd6721a1ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:45:51.800828 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.quota [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Getting quotas for user 4a59322ececb422f955e4f583c3fbdbe and project f5422e72a4e64b30af144dd6721a1ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=124550) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:45:51.812206 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Going to run 1 instances... {{(pid=124550) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:45:51.814710 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124550) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:45:51.857319 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [b5552d01-834a-4a79-8e7c-8eb8e5145e27] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 14:45:52.867153 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [b5552d01-834a-4a79-8e7c-8eb8e5145e27] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45412. Jul 12 14:45:52.871020 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6ab43c50-e6b6-4f14-b4f2-f46d025ce20c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508261 Jul 12 14:45:52.871672 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 548/1078] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:45:52.879767 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:52.880519 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:52.884692 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-4d57fe42-6e44-4a19-bb89-c077fc00a604 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:52.885308 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-4d57fe42-6e44-4a19-bb89-c077fc00a604 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:52.944501 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-4d57fe42-6e44-4a19-bb89-c077fc00a604 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:52.952008 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-4d57fe42-6e44-4a19-bb89-c077fc00a604 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1218 microversion: 2.1 time: 0.074241 Jul 12 14:45:52.952563 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 531/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:52 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:53.968882 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:53.969570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:53.977571 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:53.978026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:53.978817 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:53.979331 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:54.062836 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:54.070441 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-ecffbec4-79ce-490d-bd66-664ec3c541e6 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1276 microversion: 2.1 time: 0.105236 Jul 12 14:45:54.071003 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 549/1080] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:53 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:55.088257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:55.088876 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:55.095513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:55.095966 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:55.096736 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:55.097170 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:55.130152 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-a3590328-bfd5-4386-a7c0-467d1b1ee42a req-65c6b341-16a7-45e1-b201-a8383e1dc250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6365ea5d-adb5-48d0-aa5d-4db8199deb48", "tag": "c8e4f429-6874-40df-8014-8d28eaa2f4ab"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:45:55.144077 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a3590328-bfd5-4386-a7c0-467d1b1ee42a req-65c6b341-16a7-45e1-b201-a8383e1dc250 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:55.144550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-a3590328-bfd5-4386-a7c0-467d1b1ee42a req-65c6b341-16a7-45e1-b201-a8383e1dc250 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:55.157977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-a3590328-bfd5-4386-a7c0-467d1b1ee42a req-65c6b341-16a7-45e1-b201-a8383e1dc250 service nova] Creating event network-changed:c8e4f429-6874-40df-8014-8d28eaa2f4ab for instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 on hv-cinder-83699 Jul 12 14:45:55.163442 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-a3590328-bfd5-4386-a7c0-467d1b1ee42a req-65c6b341-16a7-45e1-b201-a8383e1dc250 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037734 Jul 12 14:45:55.164248 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 550/1081] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:45:55.237504 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:55.245209 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b2507a00-f699-4e8f-a842-f77633fccec7 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.161410 Jul 12 14:45:55.245889 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 532/1082] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:55 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:56.261841 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:56.262541 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:56.269281 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:56.269755 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:56.270522 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:56.270958 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:56.487908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:56.495450 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c54a0138-3d39-4d0e-8514-d4eeddac3e0c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.237873 Jul 12 14:45:56.496028 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 551/1083] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:56 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:57.512913 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:57.513561 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:57.519591 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:57.520047 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:57.520818 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:57.521257 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:57.648646 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:57.656161 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2fc1700e-4765-4376-a191-ec62dbe2a331 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.147857 Jul 12 14:45:57.656726 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 533/1084] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:57 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:58.674568 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:58.675143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:58.682078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:58.682634 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:58.683451 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:58.683892 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:58.813129 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:58.820727 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-5efb758d-b79d-433c-8488-6e2b93e46370 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.151130 Jul 12 14:45:58.821315 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 552/1085] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:58 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:45:59.837885 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:45:59.838508 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:45:59.845004 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:59.845500 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:59.846275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:45:59.846717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:45:59.974837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:45:59.983030 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e06315fe-06d0-47c1-9e4f-3cbeeb54e6ed tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.149668 Jul 12 14:45:59.983607 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 534/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:45:59 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:00.299938 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:46:00.300166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:46:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:46:00.427829 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-140fabdd-3aa3-4e0d-8fb9-977521b84590 req-9a688889-3212-495a-b0a5-be790d4c6dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6365ea5d-adb5-48d0-aa5d-4db8199deb48", "name": "network-vif-plugged", "status": "completed", "tag": "c8e4f429-6874-40df-8014-8d28eaa2f4ab"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:00.435730 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-140fabdd-3aa3-4e0d-8fb9-977521b84590 req-9a688889-3212-495a-b0a5-be790d4c6dea service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:00.436172 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-140fabdd-3aa3-4e0d-8fb9-977521b84590 req-9a688889-3212-495a-b0a5-be790d4c6dea service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:00.447347 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-140fabdd-3aa3-4e0d-8fb9-977521b84590 req-9a688889-3212-495a-b0a5-be790d4c6dea service nova] Creating event network-vif-plugged:c8e4f429-6874-40df-8014-8d28eaa2f4ab for instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 on hv-cinder-83699 Jul 12 14:46:00.452237 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-140fabdd-3aa3-4e0d-8fb9-977521b84590 req-9a688889-3212-495a-b0a5-be790d4c6dea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147798 Jul 12 14:46:00.452806 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 553/1087] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:01.000807 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:01.001384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:01.007445 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:01.007902 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:01.009258 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:01.009725 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:01.143301 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:01.150754 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-98b60dd2-85d3-4102-9c75-e35a83d038f2 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1318 microversion: 2.1 time: 0.154386 Jul 12 14:46:01.151305 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 535/1088] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:00 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:02.164480 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:02.165749 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=6 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:02.170134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:02.170860 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:02.177990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:02.178441 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:02.179204 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:02.179639 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:02.310138 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:02.317908 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-559e8829-fdd4-4c82-9cdd-6090bda65a3b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1506 microversion: 2.1 time: 0.154838 Jul 12 14:46:02.318472 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 554/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:02 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:16.531184 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76be8662-7af3-4f2c-81b4-989c57b1190b", "device": "/dev/sdb"}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:16.532823 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:16.535217 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:16.535907 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=12 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:16.536534 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=24 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:16.543402 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:16.543852 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:16.544650 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:16.545086 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:16.811558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-61aa4724-5349-403b-a126-569cd47959bb tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "POST /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284271 Jul 12 14:46:16.812377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 536/1090] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:46:16 2022] POST /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:37.342026 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:37.342541 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:37.344419 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:37.345160 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=30 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:37.350569 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.351528 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.352289 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:37.352723 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:37.437617 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lazy-loading 'services' on Instance uuid 6365ea5d-adb5-48d0-aa5d-4db8199deb48 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:37.510097 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6b964511-8902-45bc-8fc6-76eb77a8728b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48/os-volume_attachments/76be8662-7af3-4f2c-81b4-989c57b1190b" status: 202 len: 0 microversion: 2.1 time: 0.171972 Jul 12 14:46:37.510673 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 555/1091] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:46:37 2022] DELETE /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48/os-volume_attachments/76be8662-7af3-4f2c-81b4-989c57b1190b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:46:38.623384 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:38.624160 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:38.628450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:38.629082 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:38.636590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.637033 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.637837 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.638269 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.664401 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Going to try to terminate instance {{(pid=124549) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:46:38.740843 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-d6937cc3-d06d-4be6-8dee-f1a8119b2866 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 204 len: 0 microversion: 2.1 time: 0.118608 Jul 12 14:46:38.742386 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 537/1092] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:46:38 2022] DELETE /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:46:38.751981 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:38.752711 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:38.758938 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.759384 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.760143 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:38.760581 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:38.887848 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:38.895555 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-bcc44c99-c29d-40bc-a365-c011dc7825a9 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1512 microversion: 2.1 time: 0.148309 Jul 12 14:46:38.896111 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 556/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:38 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:39.914568 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:39.915276 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:39.921737 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:39.922191 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:39.922948 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:39.923383 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:40.050426 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:40.057992 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-2b751a66-b119-41a6-999d-733a74df6996 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1512 microversion: 2.1 time: 0.148267 Jul 12 14:46:40.058552 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 538/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:39 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:40.865469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-f80ab68c-b421-4778-82ca-887d376a383b req-db13be9c-ab60-4454-9c3a-f72f3eca2fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6365ea5d-adb5-48d0-aa5d-4db8199deb48", "name": "network-vif-deleted", "tag": "c8e4f429-6874-40df-8014-8d28eaa2f4ab"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:40.874061 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f80ab68c-b421-4778-82ca-887d376a383b req-db13be9c-ab60-4454-9c3a-f72f3eca2fa0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:40.874503 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-f80ab68c-b421-4778-82ca-887d376a383b req-db13be9c-ab60-4454-9c3a-f72f3eca2fa0 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:40.885464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-f80ab68c-b421-4778-82ca-887d376a383b req-db13be9c-ab60-4454-9c3a-f72f3eca2fa0 service nova] Creating event network-vif-deleted:c8e4f429-6874-40df-8014-8d28eaa2f4ab for instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 on hv-cinder-83699 Jul 12 14:46:40.890520 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-f80ab68c-b421-4778-82ca-887d376a383b req-db13be9c-ab60-4454-9c3a-f72f3eca2fa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028657 Jul 12 14:46:40.891118 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 557/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:41.075778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:41.076335 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:41.082848 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:41.083300 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:41.084070 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:41.084510 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:41.116953 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:41.117440 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:41.117897 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lazy-loading 'fault' on Instance uuid 6365ea5d-adb5-48d0-aa5d-4db8199deb48 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:46:41.158775 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:41.166513 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-7a95eeea-4641-4872-9e7f-086d72946444 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 200 len: 1308 microversion: 2.1 time: 0.094784 Jul 12 14:46:41.167081 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 539/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:41 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:42.184977 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:42.185687 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 6365ea5d-adb5-48d0-aa5d-4db8199deb48] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:42.192066 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:42.192511 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:42.193262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:42.193717 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:42.206878 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.wsgi [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] HTTP exception thrown: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Request method failure captured: Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: request: GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 HTTP/1.1 Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept: application/json Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Accept-Encoding: identity Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Connection: close Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Length: 0 Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Content-Type: application/json Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Host: 10.222.0.25 Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Openstack-System-Scope: None Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: User-Agent: python-urllib3/1.26.9 Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Auth-Token: gAAAAABizYkdiJjAWQK_xC5EmBdRou2lXP3yENL2mdGwLG2PRYuS4fmeJsMGqSLnyJexeVeSjoGjfADbD2dhFJ3o0EP9fGaQqg863tPOQk2Iv5xbZNbYY6SLKfWPPimIdgku8ESd4vlZhygb6zKPiNlsbmGpwXcGxfWLFsaTrLm0qHLCJy4OUNE Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Id: None Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Domain-Name: None Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Identity-Status: Confirmed Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Is-Admin-Project: True Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Id: default Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Domain-Name: Default Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Id: f5422e72a4e64b30af144dd6721a1ebc Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Role: reader,member Jul 12 14:46:42.208488 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Roles: reader,member Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f5422e72a4e64b30af144dd6721a1ebc", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Id: f5422e72a4e64b30af144dd6721a1ebc Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User: tempest-VolumesSnapshotTestJSON-938014384-project Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Id: default Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Domain-Name: Default Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Id: 4a59322ececb422f955e4f583c3fbdbe Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: X-User-Name: tempest-VolumesSnapshotTestJSON-938014384-project Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: method: > Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: exception: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. Jul 12 14:46:42.210764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: action_args: {'id': '6365ea5d-adb5-48d0-aa5d-4db8199deb48'} Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:46:42.211764 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. Jul 12 14:46:42.213420 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: ERROR nova.api.openstack.wsgi Jul 12 14:46:42.215065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Returning 404 to user: Instance 6365ea5d-adb5-48d0-aa5d-4db8199deb48 could not be found. {{(pid=124550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:46:42.215065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-6af706eb-8203-4045-9bed-3d21331fa225 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48" status: 404 len: 111 microversion: 2.1 time: 0.029617 Jul 12 14:46:42.215065 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 558/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:42 2022] GET /compute/v2.1/servers/6365ea5d-adb5-48d0-aa5d-4db8199deb48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:46:49.947409 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1215171094", "imageRef": "09352e8e-e06c-4d8a-9bb3-aa5c64dda879", "flavorRef": "452", "networks": [{"uuid": "ca67d2a4-8a1b-4d39-bc20-55e6141b0a9d"}]}} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:49.997871 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.network.neutron [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] validate_networks() for [('ca67d2a4-8a1b-4d39-bc20-55e6141b0a9d', None, None, None, None, None)] {{(pid=124549) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 14:46:50.398434 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Flavor limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 14:46:50.398860 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Image limits 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 14:46:50.399330 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Flavor pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 14:46:50.399741 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Image pref 0:0:0 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 14:46:50.400146 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.virt.hardware [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 14:46:50.411641 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.412036 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.412851 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:50.413924 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:50.430548 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Getting quotas for project f5422e72a4e64b30af144dd6721a1ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 14:46:50.434530 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.quota [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Getting quotas for user 4a59322ececb422f955e4f583c3fbdbe and project f5422e72a4e64b30af144dd6721a1ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=124549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 14:46:50.445747 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Going to run 1 instances... {{(pid=124549) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 14:46:50.448019 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09352e8e-e06c-4d8a-9bb3-aa5c64dda879',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 14:46:50.494282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-86a134fd-7967-46fd-bae1-8cfb88b6af1d tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551243 Jul 12 14:46:50.495116 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 540/1098] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Jul 12 14:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 14:46:50.505078 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d94f0b97-625c-49ac-ab72-ecff28e11b8a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:50.505713 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d94f0b97-625c-49ac-ab72-ecff28e11b8a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:50.559440 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d94f0b97-625c-49ac-ab72-ecff28e11b8a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:50.567838 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d94f0b97-625c-49ac-ab72-ecff28e11b8a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1219 microversion: 2.1 time: 0.066680 Jul 12 14:46:50.568478 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 559/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:50 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:51.586441 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:51.587228 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:51.593494 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.593944 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.594717 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:51.595152 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:51.661688 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:51.670211 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-b145d3d2-732b-487c-bdf8-8f125f096ce1 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1277 microversion: 2.1 time: 0.088962 Jul 12 14:46:51.670724 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 541/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:51 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:52.687483 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:52.688756 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:52.691545 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:52.698246 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.698635 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.699410 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:52.699847 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:52.915718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:52.923547 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-02ed6931-2400-44e7-bc1c-272854f810ec tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.240181 Jul 12 14:46:52.924120 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 560/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:52 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:53.012567 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-a9f7322d-533e-4f93-9f79-29ee4ce962c8 req-bf7b9bb1-bb21-429b-83e2-a814a6cb8802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99758674-f851-4a0d-8d13-2609eab970e7", "tag": "edd48bce-114f-415d-8192-e30e036d64ed"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:53.023294 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a9f7322d-533e-4f93-9f79-29ee4ce962c8 req-bf7b9bb1-bb21-429b-83e2-a814a6cb8802 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.023839 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-a9f7322d-533e-4f93-9f79-29ee4ce962c8 req-bf7b9bb1-bb21-429b-83e2-a814a6cb8802 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.039243 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-a9f7322d-533e-4f93-9f79-29ee4ce962c8 req-bf7b9bb1-bb21-429b-83e2-a814a6cb8802 service nova] Creating event network-changed:edd48bce-114f-415d-8192-e30e036d64ed for instance 99758674-f851-4a0d-8d13-2609eab970e7 on hv-cinder-83699 Jul 12 14:46:53.044994 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-a9f7322d-533e-4f93-9f79-29ee4ce962c8 req-bf7b9bb1-bb21-429b-83e2-a814a6cb8802 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036180 Jul 12 14:46:53.045618 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 542/1102] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:46:53.940591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:53.941211 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:53.947712 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.948245 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:53.949014 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:53.949475 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:54.080021 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:54.087867 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-cf282fa0-c215-4080-94ad-1b8c0d27712a tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.151413 Jul 12 14:46:54.088430 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 561/1103] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:53 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:55.105351 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:55.106237 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:55.112790 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:55.113232 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:55.114022 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:55.114454 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:55.240856 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:55.248719 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-5e6e47e0-9730-44d2-9de2-6778d003d355 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.148338 Jul 12 14:46:55.249275 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 543/1104] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:55 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:56.264510 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:56.265142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:56.271682 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.272732 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:56.273590 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:56.274023 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:56.403069 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:56.413484 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-fe6c6223-6ba8-4678-ada7-7a9de42b73bc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.151726 Jul 12 14:46:56.414492 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 562/1105] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:56 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:57.436166 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:57.436778 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:57.443111 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:57.443558 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:57.444834 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:57.445262 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:57.573683 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:57.580971 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bbeef893-c3a0-4f64-8280-4c433bd7d197 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.148803 Jul 12 14:46:57.581590 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 544/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:57 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:58.583136 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [req-5fd6a5f2-87c4-4daf-9fb5-e7cdc0ae1481 req-28dc5cf1-9cfd-46f0-a70e-0a56a68f1f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99758674-f851-4a0d-8d13-2609eab970e7", "name": "network-vif-plugged", "status": "completed", "tag": "edd48bce-114f-415d-8192-e30e036d64ed"}]} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:46:58.591602 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5fd6a5f2-87c4-4daf-9fb5-e7cdc0ae1481 req-28dc5cf1-9cfd-46f0-a70e-0a56a68f1f0b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.592134 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [req-5fd6a5f2-87c4-4daf-9fb5-e7cdc0ae1481 req-28dc5cf1-9cfd-46f0-a70e-0a56a68f1f0b service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.599753 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:58.600430 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:58.604171 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.compute.server_external_events [req-5fd6a5f2-87c4-4daf-9fb5-e7cdc0ae1481 req-28dc5cf1-9cfd-46f0-a70e-0a56a68f1f0b service nova] Creating event network-vif-plugged:edd48bce-114f-415d-8192-e30e036d64ed for instance 99758674-f851-4a0d-8d13-2609eab970e7 on hv-cinder-83699 Jul 12 14:46:58.608914 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.609397 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.609609 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [req-5fd6a5f2-87c4-4daf-9fb5-e7cdc0ae1481 req-28dc5cf1-9cfd-46f0-a70e-0a56a68f1f0b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030218 Jul 12 14:46:58.610373 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 563/1107] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 14:46:58.610509 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:58.610845 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:58.746057 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:58.754399 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-948f9bb8-d1fb-482c-807b-4907c5e59165 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.159527 Jul 12 14:46:58.754972 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 545/1108] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:58 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:46:59.772439 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:46:59.773047 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:46:59.779297 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.779747 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.780506 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:46:59.780948 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:46:59.919121 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:46:59.926970 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-d36dbb7e-a27f-4c6a-b3f2-0f5dc08c46f4 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1319 microversion: 2.1 time: 0.159288 Jul 12 14:46:59.927718 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 564/1109] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:46:59 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:00.944322 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:00.944887 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:00.947321 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=2 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:00.948000 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell0:SELECT=6 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:00.954031 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.954516 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:00.955290 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:00.955730 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:01.082595 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:01.090615 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-9b666b2b-e6dd-4713-b712-665701639041 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1508 microversion: 2.1 time: 0.150244 Jul 12 14:47:01.091176 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 546/1110] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:00 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:01.107386 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1f1ac96-2f2a-4d45-af95-96fbd71a3d12", "device": "/dev/sdb"}} {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:01.108972 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:01.111030 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell0:SELECT=2 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:01.117298 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:01.117776 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:01.118550 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:01.118990 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:01.356436 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-c7f64e7d-083e-436b-a8a8-e6e65fcf627c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "POST /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252903 Jul 12 14:47:01.357142 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 565/1111] 10.222.0.25 () {60 vars in 1322 bytes} [Tue Jul 12 14:47:01 2022] POST /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:18.569698 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:18.570221 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:18.572654 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:18.573431 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG dbcounter [-] [124549] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:18.579559 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:18.580013 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:18.580786 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:18.581223 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:18.664315 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.objects.instance [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lazy-loading 'services' on Instance uuid 99758674-f851-4a0d-8d13-2609eab970e7 {{(pid=124549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:47:18.735266 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-bd0f2de2-f77f-47c2-ac83-ae6003852403 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7/os-volume_attachments/d1f1ac96-2f2a-4d45-af95-96fbd71a3d12" status: 202 len: 0 microversion: 2.1 time: 0.170509 Jul 12 14:47:18.735856 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 547/1112] 10.222.0.25 () {58 vars in 1415 bytes} [Tue Jul 12 14:47:18 2022] DELETE /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7/os-volume_attachments/d1f1ac96-2f2a-4d45-af95-96fbd71a3d12 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 14:47:19.841722 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_api:SELECT=24 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:19.842603 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG dbcounter [-] [124550] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:19.846651 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:19.847220 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:19.855469 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.855912 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:19.856667 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.857100 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:19.880965 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Going to try to terminate instance {{(pid=124550) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 14:47:19.955557 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-68ce55ac-7b9a-45fc-9b16-0a7c559900cc tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 204 len: 0 microversion: 2.1 time: 0.115038 Jul 12 14:47:19.956149 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 566/1113] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Jul 12 14:47:19 2022] DELETE /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 14:47:19.966201 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:19.966901 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:19.973195 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.973681 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:19.974448 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:19.974884 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:20.107857 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.policy [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124549) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:20.115450 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-e38f1fe5-7a33-4c30-99bf-e9f105deff6b tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1514 microversion: 2.1 time: 0.153962 Jul 12 14:47:20.116017 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 548/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:19 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:21.134257 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:21.135010 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:21.141458 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.141906 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.142662 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:21.143092 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:21.270930 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:21.278466 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-55be6dba-cabf-49e9-a6b5-2d963152b680 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1514 microversion: 2.1 time: 0.149147 Jul 12 14:47:21.279032 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 567/1115] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:21 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:22.078142 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [req-c038ea64-02ea-4a60-8b0b-a055d00da601 req-30c3e8b1-7b08-423f-aaa3-4479e13648c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99758674-f851-4a0d-8d13-2609eab970e7", "name": "network-vif-deleted", "tag": "edd48bce-114f-415d-8192-e30e036d64ed"}]} {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 14:47:22.087282 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c038ea64-02ea-4a60-8b0b-a055d00da601 req-30c3e8b1-7b08-423f-aaa3-4479e13648c5 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.087733 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [req-c038ea64-02ea-4a60-8b0b-a055d00da601 req-30c3e8b1-7b08-423f-aaa3-4479e13648c5 service nova] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.101189 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.compute.server_external_events [req-c038ea64-02ea-4a60-8b0b-a055d00da601 req-30c3e8b1-7b08-423f-aaa3-4479e13648c5 service nova] Creating event network-vif-deleted:edd48bce-114f-415d-8192-e30e036d64ed for instance 99758674-f851-4a0d-8d13-2609eab970e7 on hv-cinder-83699 Jul 12 14:47:22.106449 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [req-c038ea64-02ea-4a60-8b0b-a055d00da601 req-30c3e8b1-7b08-423f-aaa3-4479e13648c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Jul 12 14:47:22.107027 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 549/1116] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Jul 12 14:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 14:47:22.295591 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.api.openstack.wsgi [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:22.296185 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.compute.api [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124550) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:22.302570 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.303013 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.303771 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.304201 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.335376 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:22.335818 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG oslo_concurrency.lockutils [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:22.336260 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.objects.instance [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lazy-loading 'fault' on Instance uuid 99758674-f851-4a0d-8d13-2609eab970e7 {{(pid=124550) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 14:47:22.375262 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: DEBUG nova.policy [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a59322ececb422f955e4f583c3fbdbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5422e72a4e64b30af144dd6721a1ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124550) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 14:47:22.383052 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO nova.api.openstack.requestlog [None req-e61943b9-c6d0-4de6-97bd-18864867707c tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 200 len: 1309 microversion: 2.1 time: 0.091526 Jul 12 14:47:22.383608 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: [pid: 124550|app: 0|req: 568/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:22 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 14:47:23.400157 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Calling method '>' {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 14:47:23.400846 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.compute.api [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] [instance: 99758674-f851-4a0d-8d13-2609eab970e7] Fetching instance by UUID {{(pid=124549) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 14:47:23.407133 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.407579 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.408339 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 14:47:23.408771 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG oslo_concurrency.lockutils [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Lock "2ea54ec8-f77b-40e9-aab9-7dc95a6b35b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 14:47:23.422083 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.wsgi [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] HTTP exception thrown: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Request method failure captured: Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: request: GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 HTTP/1.1 Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept: application/json Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Accept-Encoding: identity Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Connection: close Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Length: 0 Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Content-Type: application/json Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Host: 10.222.0.25 Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Openstack-System-Scope: None Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: User-Agent: python-urllib3/1.26.9 Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Auth-Token: gAAAAABizYkdiJjAWQK_xC5EmBdRou2lXP3yENL2mdGwLG2PRYuS4fmeJsMGqSLnyJexeVeSjoGjfADbD2dhFJ3o0EP9fGaQqg863tPOQk2Iv5xbZNbYY6SLKfWPPimIdgku8ESd4vlZhygb6zKPiNlsbmGpwXcGxfWLFsaTrLm0qHLCJy4OUNE Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Id: None Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Domain-Name: None Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Identity-Status: Confirmed Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Is-Admin-Project: True Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Id: default Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Domain-Name: Default Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Id: f5422e72a4e64b30af144dd6721a1ebc Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Role: reader,member Jul 12 14:47:23.423729 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Roles: reader,member Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f5422e72a4e64b30af144dd6721a1ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f5422e72a4e64b30af144dd6721a1ebc", "adminURL": "http://10.222.0.25:8080"}]}] Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Id: f5422e72a4e64b30af144dd6721a1ebc Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938014384 Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User: tempest-VolumesSnapshotTestJSON-938014384-project Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Id: default Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Domain-Name: Default Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Id: 4a59322ececb422f955e4f583c3fbdbe Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: X-User-Name: tempest-VolumesSnapshotTestJSON-938014384-project Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: method: > Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: exception: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. Jul 12 14:47:23.425573 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: action_args: {'id': '99758674-f851-4a0d-8d13-2609eab970e7'} Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: {{(pid=124549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 14:47:23.426820 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. Jul 12 14:47:23.429163 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: ERROR nova.api.openstack.wsgi Jul 12 14:47:23.430873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: DEBUG nova.api.openstack.wsgi [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] Returning 404 to user: Instance 99758674-f851-4a0d-8d13-2609eab970e7 could not be found. {{(pid=124549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 14:47:23.430873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO nova.api.openstack.requestlog [None req-250f499c-76b8-4e76-ab84-014087c5f378 tempest-VolumesSnapshotTestJSON-938014384 tempest-VolumesSnapshotTestJSON-938014384-project] 10.222.0.25 "GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7" status: 404 len: 111 microversion: 2.1 time: 0.029729 Jul 12 14:47:23.430873 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: [pid: 124549|app: 0|req: 550/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Jul 12 14:47:23 2022] GET /compute/v2.1/servers/99758674-f851-4a0d-8d13-2609eab970e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 14:47:42.668499 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:47:42.669132 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:47:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:49:10.015942 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:49:10.016562 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:49:20.310377 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:49:20.310979 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:49:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:50:58.509907 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:50:58.510464 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:51:02.676588 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:51:02.677068 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:52:30.025090 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:52:30.025731 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:52:40.319779 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:52:40.320346 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:52:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:52:51.053627 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:52:51.054297 dv-cinder-836996-39-iscsi devstack@n-api.service[124549]: Tue Jul 12 14:52:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 14:52:58.344060 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 14:52:58.344629 dv-cinder-836996-39-iscsi devstack@n-api.service[124550]: Tue Jul 12 14:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!